The family life of Tjong A Fie reflects his long journey, both in China and in the Dutch East Indies. Throughout his life, he was known to have been married three times.

In his early years in China, he married a woman with the surname Lie. After arriving in Deli, he married again to a woman named Chew from Penang. From this marriage, he had three children. However, both of these wives passed away, and little historical record remains regarding his early family life.

His third marriage to Lim Koei Yap, who was from Binjai, is the most widely known. From this marriage, he had seven children: Tjong Foek Yin (Queeny Chang) , Tjong Fa Liong, Tjong Kian Liong, Tjong Kwet Liong, Tjong Sze Yin, Tjong Lie Liong and Tjong Tsoeng Liong.

The children from this marriage grew up in a family environment closely connected to business and social activities. Some later continued the family’s business legacy, while others established their lives in different places, both in Medan and abroad.