Smaller, lighter, and better battery life.
IGN also reports that a Sony representative demoed a new PSP function which outputs PSP video to another source. This could possibly be an awesome way to enjoy your PSP games at home on your home theater set up!
I think the better D-pad response is worthy of comment too, surely.