By definition a celestial body is any natural body outside of the Earth's atmosphere. Easy examples are the Moon, Sun, and the other planets of our solar system. But those are very limited examples
Perhaps the most important reason to study astronomy is that astronomy seeks to satisfy our fundamental curiosity about the world we live in, and answer the 'big' questions.