Analisis ChatGPT dan Perplexity pada Mata Pelajaran Dasar Program Keahlian dengan Jaccard Similarity

Kartika Candra Kirana, Januari Adi Prasetya, Slamet Wibawanto

Abstract


ChatGPT and Perplexity are two applications that can be utilized to develop learning materials. However, no research has measured the completeness of material produced by artificial intelligence. Thus, this research aims to analyze ChatGPT and Perplexity as the material collection tool. The material completeness is measured using Jaccard Similarity which compares objects with intersection. Assuming that material completeness can be measured through the intersection of the same material, Jaccard Similarity is proposed with three material search trials using core competencies, basic competencies, and core materials. It was implemented in the Electrical Power Installation Engineering learning material. Then, Jaccard Similarity is analyzed with teacher validation. The result shows that ChatGPT and Perplexity achieved the highest assessment in core material searching, reaching similarity up to 72.40℅ and 47.67% respectively. Both validations reached 80% and 70% respectively. It was concluded that ChatGPT was superior to Perplexity and the best keywords based on the core material.

Keywords


Kecerdasan Buatan; Jaccard Simmilarity; Indeks Similaritas; Analisa Materi Pembelajaran; ChatGPT ; Perplexity

Full Text:

PDF

References


Alobed, M., Altrad, A. M. M., & Bakar, Z. B. A. (2021). A Comparative Analysis of Euclidean, Jaccard and Cosine Similarity Measure and Arabic Wordnet for Automated Arabic Essay Scoring. 2021 Fifth International Conference on Information Retrieval and Knowledge Management (CAMP), 70–74. https://doi.org/10.1109/CAMP51653.2021.9498119

Anggriani, I., Sukmara, R. B., Prihasto, B., Fajri Azhar, N., & Kalimantan, I. T. (2023). Pemanfaat Kecerdasan Buatan dalam Pengembangan Pembelajaran di Daerah Penyangga Ibukota Negara (IKN). ININNAWA: Jurnal Pengabdian Masyarakat, 01(02), 131–134. https://journal.unm.ac.id/index.php/Ininnawa

Baharav, T. Z., Kamath, G. M., Tse, D. N., & Shomorony, I. (2020). Spectral Jaccard Similarity: A New Approach to Estimating Pairwise Sequence Alignments. Patterns, 1(6), 100081. https://doi.org/10.1016/j.patter.2020.100081

Costa, L. da F. (2021). Further Generalizations of the Jaccard Index. http://arxiv.org/abs/2110.09619

Deike, M. (2024). Evaluating the performance of ChatGPT and Perplexity AI in Business Reference. Journal of Business & Finance Librarianship. https://api.semanticscholar.org/CorpusID:268194617

Eldaw, M. H. S., Levene, M., & Roussos, G. (2019). Presence Analytics: Making Sense of Human Social Presence within a Learning Environment. Proceedings - 5th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2018, 174–183. https://doi.org/10.1109/BDCAT.2018.00029

Iriyani, S., Patty, E., Akbar, A., Idris, R., Ayu, B., Priyudahari, P., & Artikel, G. (2023). Studi Literatur: Pemanfaatan Teknologi Chat GPT dalam Pendidikan. 1, 9–16. https://doi.org/10.30812/upgrade.v0i0.3151

Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News, 40(3), 26–29. https://doi.org/10.1108/LHTN-01-2023-0009

Marizal, Y., & Asri, Y. (2022). Pengembangan Modul Elektronik Berbantuan Aplikasi Flipping Book PDF Professional Pembelajaran Menulis Teks Eksplanasi. Diglosia: Jurnal Kajian Bahasa, Sastra, Dan Pengajarannya, 5, 135–152. https://doi.org/10.30872/diglosia.v5i1.343

Maulana, M. J., Darmawan, C., & Rahmat, R. (2023). PENGGUNAAN CHATGPT DALAM TINJAUAN PENDIDIKAN BERDASARKAN PERSPEKTIF ETIKA AKADEMIK. Bhineka Tunggal Ika: Kajian Teori Dan Praktik Pendidikan PKn, 10(1), 58–66. https://doi.org/10.36706/jbti.v10i1.21090

Mujab, S. (2023). Transformasi Pendidikan SMK : Menuju SDM Unggul, Kreatif, dan Inovatif Berkelanjutan (M. P. Kodri (ed.)). Penerbit Adab.

Mulyasa, E. (2023). Implementasi Kurikulum Merdeka. Bumi Aksara.

Niwattanakul, S., Singthongchai, J., Naenudorn, E., & Wanapu, S. (2013). Using of jaccard coefficient for keywords similarity. Lecture Notes in Engineering and Computer Science, 2202, 380–384.

Rathore, D. B. (2023). Future of AI & Generation Alpha: ChatGPT beyond Boundaries. Eduzone : International Peer Reviewed/Refereed Academic Multidisciplinary Journal, 12(01), 63–68. https://doi.org/10.56614/eiprmj.v12i1y23.254

Rinjeni, T. P., Indriawan, A., & Rakhmawati, N. A. (2024). Matching Scientific Article Titles using Cosine Similarity and Jaccard Similarity Algorithm. Procedia Computer Science, 234, 553–560. https://doi.org/https://doi.org/10.1016/j.procs.2024.03.039

Sari, Y. L., & Elfizon, E. (2020). Hubungan Penguasaan Teori Pemasangan Instalasi Penerangan Listrik Berbantuan Modul Dengan Kompetensi Praktik Siswa di SMK Negeri 1 Pariaman. JTEV (Jurnal Teknik Elektro Dan Vokasional). https://api.semanticscholar.org/CorpusID:250197175

Tang, M., Kaymaz, Y., Logeman, B. L., Eichhorn, S., Liang, Z. S., Dulac, C., & Sackton, T. B. (2021). Evaluating single-cell cluster stability using the Jaccard similarity index. Bioinformatics, 37(15), 2212–2214. https://doi.org/10.1093/bioinformatics/btaa956




DOI: https://doi.org/10.47213/bp.v6i1.315

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Kartika Candra Kirana

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Statistik BP


Belantika Pendidikan

Jendela Pendidikan Indonesia

Kayon Media

Lisensi Creative Commons

Belantika Pendidikan is licensed under Creative Commons Attribution-ShareAlike 4.0 International License