Anyone know of any nice national or state parks with caves/hiking/and on-site lodging?

I have visited Giant City state park in southern Illinois and really liked it. They had hiking and glaciers and really nice cabins on the site. I was wondering if there was anything like that has caves and fossils and stuff like that. I haven’t done much traveling in the western part of the U.S. I’d prefer something in the southwest. Any ideas? I do want a place that has on-site lodging.

As it happens, my daughter and son-in-law just came back from Oregon Caves National Park with some caves & waterfalls pictures.

The US Parks web page for it is at http://www.nps.gov/orca/

with some lodging, hiking, tour info at
http://www.nps.gov/archive/orca/home.html

The pictures are fascinating, but I can’t speak firsthand because I’ve never been there.

I’ve been to the Pinnacles in California (when I was a kid), but I’m not sure they’re still open to the public. We are an area of earthquakes…