The early history of UPT Perpustakaan UNJ comes from the library of the Fakultas Keguruan dan Ilmu Pendidikan, Universitas Indonesia (FKIP UI). Based on Keputusan Presiden No. 1 Tahun 1963, FKIP changed to Institut Keguruan dan Ilmu Pendidikan (IKIP). IKIP Jakarta itself was established on May 16, 1964. In accordance with the SK Rektor IKIP Jakarta No. 084, IKIP Jakarta Library is tasked with being the central library that coordinates and supervises libraries in the Fakultas dan Sekolah Laboratorium Kependidikan.
In 1999 in accordance with the Keputusan Presiden RI No.93/1999, IKIP Jakarta changed its status to Universitas Negeri Jakarta. So the IKIP Jakarta Library changed its name to UPT Perpustakaan Universitas Negeri Jakarta. Based on the Peraturan Menteri, Ministry of Research, Technology and Higher Education of the Republic of Indonesia dated August 3, 2016 No. 44 concerning the Organization and Work Procedure of the Universitas Negeri Jakarta, the UPT Perpustakaan is a technical implementing unit in the library sector which is under and responsible to the Chancellor and coordinated by the Deputy Chancellor for Academic Affairs.