Belts wouldn't affect idle. It's most likely the cold weather that's making the car idle higher until it's warmed up, or your IAC valve.