"It is the Furusato Kanko Hotel: http://www.japaneseguesthouses.com/db/kagoshima/furusatokanko.htm
You don't need to book a room, just ask for a ticket to the onsen. It was 1000 Yen, I think."