Definitely bring a flashlight and wear shoes with a good grip!!! The caves are amazing and some really tight spaces!! The kettles are anticlimactic but pretty cool, and the look out was beautiful and that one was a great hike.... We didn't go to the falls because we were tired and wanted to get home.... But the falls didn't have water running that day anyway!!!!
The highlight of Warsaw Caves is definitely the caves and there is a short trail leading you to them. In total there are 7 caves and their entrances are clearly marked. The area in and around them is very hilly and rocky - you need to be very careful where you place your steps. Warsaw Caves also has three hiking trails. The "Caves and Scenic Lookout" trail will lead you into a cedar forest - where you can take a short side trail to view some limestone kettles - before heading up to a nice lookout (w/picnic table) over looking the Indian River. From here, the trail darts through mixed forest, a hydro line, and then loops itself back. This trail is 4km in length, and the trail does have a lot of roots and rocks that you need to be mindful of. The Limestone and Plains trail is 7km and mostly flat, but travels through mixed forest and has a few places where you can glance down at the Indian River - there is old fencing put up to prevent people from getting too close to the edge. I found that about half the trail is pockmarked limestone and the other half single wide forest trail w/roots and rocks. There is a lot of poison ivy in the open spots in and around the limestone. The 3rd trail is mostly the same trail as the 7km one - it just loops back about 2.5kms in to take you back to the start. You miss out on the forested part, but still get the views of the river.
There is a fee to access this park. However, one can easily fill the entire day with some hiking, spelunking and then taking a dip at the beach. There are also canoe rentals and overnight camping available. Very busy during summer weekends, and a lot of poison ivy to watch out for.