On February 4, 1921, Tjong A Fie passed away suddenly in Medan due to apoplexy, or cerebral hemorrhage. His death brought deep sorrow to the wider community. Thousands of mourners from various regions—including East Sumatra, Aceh, Padang, Penang, Malaya, Singapore, and Java—came to pay their final respects.

His funeral procession was conducted with great grandeur and solemnity, reflecting his status and influence. The procession moved from Kesawan to Pulo Brayan, accompanied by a vast crowd that filled the streets of Medan. The ceremony followed traditional Chinese customs, featuring ceremonial banners, ornate funeral decorations, and a richly adorned hearse.

Several months before his passing, Tjong A Fie had prepared a will that reflected his strong commitment to social welfare. He directed that much of his wealth be used for public benefit through a foundation, including support for education for talented but underprivileged youth, as well as assistance for those in need regardless of race, ethnicity, or background.

Tjong A Fie was laid to rest in Pulo Brayan, Medan. His burial site remains an important historical landmark, serving not only as his final resting place but also as a symbol of his enduring legacy of leadership, generosity, and social responsibility.