How it works
に (to) marks where they're heading — the ホテル (hotel). The verb is in the volitional form 戻ろう (let's go back), made from 戻る (go back); this “let's…” form proposes doing something together and is the casual counterpart of the polite 〜ましょう (let's, polite).