What are cheap places to stay when visiting Kyoto and Osaka Japan?

I'll be visiting Japan with a friend in July for 12 days. 7-day rail pes will give us 3 days in Kyoto and 3 days in Osaka, with the last day returning to Tokyo. Hostels are really the main focus, but nice hotels wouldn't hurt. Any advice would help, thanks!