Raptopoulos was born in Port Teufik, Egypt in 1951. In 1961, his family returned to Greece, settling in Piraeus. Raptopoulos developed an interest in sports, trying out for swimming with Olympiakos and football with Panathinaikos. His next stop was basketball and the youth team of Pangrati BC in 1964.
Raptopoulos remained with Pangrati until 1975. He stayed out of basketball for three seasons as he was punished and, in 1978, returned to the sport with a new club: Olympiakos. His career there lasted until 1985.