Sarganis moved on to Kastoria FC in 1978 and played for the "furriers" until the end of the 1980 season. He was part of the team that shocked the Greek football world by winning the Greek Cup in 1980. Following that triumph, he transferred to Olympiakos where he would play from 1981 until the end of the 1985 season.
During his career Sarganis was capped 58 times by the Greek National Football Team. His international high point came on October 15 of 1980, when he preserved a 1-0 Greek victory in Copenhagen against Denmark. The Danish press gave him the nickname "phantom" by which he would be known throughout the rest of his career.