A few necessities. Public toilets and WiFi - major hotel lobbies usually have both free WiFi and clean restrooms that you can use. As a Tour Guide, I use them all the time!
All NYC subway stations have wifi and cellular as well as most of the time on the trains. Most NYC parks and all NYC libraries have free wifi. Of course there also many cafés in the city as well, including McDonald's!
Public Toilets - This is something that New York City really needs to find a better solution to! Bryant Park has a very clean facility. Other places include Grand Central Terminal, Madison Square Park, fast food restaurants and larger stores like Macy's. NYC really needs to figure out a solution to this problem!