This is a glitch :( When you are married to them, have them forage for you, your shipping destination is their hometown, and they are scheduled to pick up your shipped items, they don't return until midnight.