Kim made the remarks at a meeting with former diplomats hosted by the Korean Council on Foreign Relations, hours before he meets with a special envoy sent by Japan's new Prime Minister Shinzo Abe to President-elect Park Geun-hye.
"I would like to emphasize that we should develop a future-oriented relationship with Japan, while protecting our territorial sovereignty and calling for Japan to look squarely at its history," Kim said at the meeting.
"Eventually, relations with Japan will pose a big challenge for Korea this year."
Foreign Minister Kim Sung-hwan (R) shakes hands with Japan's special envoy Fukushiro Nukaga during a meeting in Seoul on Jan. 4. (Yonhap)
Relations between South Korea and Japan have been strained since outgoing President Lee Myung-bak made a visit to Dokdo last August, the first by a South Korean president, and Japan strongly protested the move and renewed its claim to the East Sea islets.
Dokdo, which lies closer to South Korea in the body of water between the Korean Peninsula and Japan, has long been a thorn in relations between the two countries. South Korea keeps a small police detachment on the islets, effectively controlling them.
Later in the day, Kim met with Abe's envoy, Fukushiro Nukaga, a veteran lawmaker and former finance minister.
In his opening remarks, Kim congratulated the inauguration of Japan's new government and said he is "looking forward to a future-oriented relationship" with the Abe government.
Analysts expected diplomatic tensions between South Korea and Japan over history-related issues to continue after the hawkish Abe, who has a long history of controversial remarks toward South Korea, was inaugurated.