Can't Change Form C#

I'm trying to take a form and put another in its place. I start out with the code:

private void button1_Click(object sender, EventArgs e)
    {
    new Form2().Visible = true;
    }

That works. But when I tell the current form to close, it fails.

this.Close()