Pith. sign in

REVIEW 70 references

Recommending the right academic programs: An interest mining approach using BERTopic

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2501.06581 v1 pith:W5Y4SIUY submitted 2025-01-11 cs.LG cs.CYcs.IR

Alessandro Hill , Kalen Goo , Puneet Agarwal This is my paper · ORCID
classification cs.LGcs.CYcs.IR
keywords programprogramssystemintereststudentstopicsacademicapproach
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Prospective students face the challenging task of selecting a university program that will shape their academic and professional careers. For decision-makers and support services, it is often time-consuming and extremely difficult to match personal interests with suitable programs due to the vast and complex catalogue information available. This paper presents the first information system that provides students with efficient recommendations based on both program content and personal preferences. BERTopic, a powerful topic modeling algorithm, is used that leverages text embedding techniques to generate topic representations. It enables us to mine interest topics from all course descriptions, representing the full body of knowledge taught at the institution. Underpinned by the student's individual choice of topics, a shortlist of the most relevant programs is computed through statistical backtracking in the knowledge map, a novel characterization of the program-course relationship. This approach can be applied to a wide range of educational settings, including professional and vocational training. A case study at a post-secondary school with 80 programs and over 5,000 courses shows that the system provides immediate and effective decision support. The presented interest topics are meaningful, leading to positive effects such as serendipity, personalization, and fairness, as revealed by a qualitative study involving 65 students. Over 98% of users indicated that the recommendations aligned with their interests, and about 94% stated they would use the tool in the future. Quantitative analysis shows the system can be configured to ensure fairness, achieving 98% program coverage while maintaining a personalization score of 0.77. These findings suggest that this real-time, user-centered, data-driven system could improve the program selection process.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

70 extracted references · 5 canonical work pages

  1. [1]

    Accessed 10 November 2024 from www.statista.com/statistics/183995/ us-college-enrollment-and-projections-in-public-and-private-institutions (2023)

    Statista: College enrollment in the United States from 1965 to 2022 and projections up to 2031 for public and private colleges (in mil- lions). Accessed 10 November 2024 from www.statista.com/statistics/183995/ us-college-enrollment-and-projections-in-public-and-private-institutions (2023)

    2023

  2. [2]

    Accessed 20 August 2024 from www.mymajors

    MyMajors: List of College Majors. Accessed 20 August 2024 from www.mymajors. com/college-majors (n.d.)

    2024

  3. [3]

    Plant Sci

    Bryant, J.: How Many Colleges Are in the U.S.? Accessed 20 August 2024 from www.bestcolleges.com/blog/how-many-colleges-in-us (2023) 27 # Program 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30|p| 1 Aerospace Engineering 10 49 0 59 4 14 9 0 100 15 17 5 5 2 16 5 13 44 35 52 102 9 73 17 67 31 17 9 258 16 952 Agricultural and...

    2023

  4. [4]

    Accessed 20 August 2024 from www

    Statista: Expenditure on higher education as a share of GDP in selected countries worldwide in 2020, by source of funding. Accessed 20 August 2024 from www. statista.com/statistics/707557/higher-education-spending-share-gdp (2023)

    2023

  5. [5]

    Accessed 10 November 2024 from nces.ed.gov/programs/coe/indicator/cmd/ education-expenditures-by-country (2023)

    National Center for Education Statistics: Education Expenditures by Coun- try. Accessed 10 November 2024 from nces.ed.gov/programs/coe/indicator/cmd/ education-expenditures-by-country (2023)

    2023

  6. [6]

    Accessed 10 November 2024 from www.bestcolleges.com/ research/college-students-doubt-major-choice-survey (2024)

    Welding, L.: More Than Half of College Students Experience Doubt About Their Choice of Major. Accessed 10 November 2024 from www.bestcolleges.com/ research/college-students-doubt-major-choice-survey (2024)

    2024

  7. [7]

    2 The colleges recommended to the 65 experiment users, encoded in the binary program rec- ommendation matrix M R,P

    Stolzenberg, E.B., Eagan, M.K., Aragon, M.C., Cesar-Davis, N.M., Jacobo, S., 29 Fig. 2 The colleges recommended to the 65 experiment users, encoded in the binary program rec- ommendation matrix M R,P . Couch, V., Rios-Aguilar, C.: The American freshman: National norms fall 2019. Higher Education Research Institute, UCLA (2019)

    2019

  8. [8]

    SIGCSE Bulletin 40(1), 402–406 (2008)

    Biggers, M., Brauer, A., Yilmaz, T.: Student perceptions of computer science: A retention study comparing graduating seniors with CS leavers. SIGCSE Bulletin 40(1), 402–406 (2008)

    2008

Show all 70 references
  1. [9]

    Accessed 20 August 2024 from www.ziprecruiter.com/blog/regret-free-college-majors (2022)

    Buber, S.: The Most Regretted and Most Loved College Majors. Accessed 20 August 2024 from www.ziprecruiter.com/blog/regret-free-college-majors (2022)

    2022

  2. [10]

    Policy insights from the behavioral and brain sciences 3(2), 220–227 (2016)

    Harackiewicz, J.M., Smith, J.L., Priniski, S.J.: Interest matters: The importance of promoting interest in education. Policy insights from the behavioral and brain sciences 3(2), 220–227 (2016)

    2016

  3. [11]

    European Journal of 30 Fig

    Hatzakis, T., Lycett, M., Serrano, A.: A programme management approach for ensuring curriculum coherence in is (higher) education. European Journal of 30 Fig. 3 The colleges recommended to the 65 experiment users, encoded in the binary college recom- mendation matrix M R,C (le...

    2007

  4. [12]

    Decision Sciences 55(1), 7–16 (2024)

    Tang, C.S.: Diversity, equity, and inclusion: decision science research opportuni- ties. Decision Sciences 55(1), 7–16 (2024)

    2024

  5. [13]

    International Journal of Information Technology and Electrical Engineering 3(4), 128–132 (2020)

    Permanasari, A.E., Wisaksono, M., Kusumawardani, S.S.: A multi criteria deci- sion making to support major selection of senior high school. International Journal of Information Technology and Electrical Engineering 3(4), 128–132 (2020)

    2020

  6. [14]

    In: 2nd International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), pp

    Khasanah, F.N., Permanasari, A.E., Suning Kusumawardani, S.: Fuzzy MADM for major selection at senior high school. In: 2nd International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), pp. 41–45 (2015). IEEE

    2015

  7. [15]

    Decision Support Systems 142, 113470 (2021)

    Conejero, J.M., Preciado, J.C., Prieto, A.E., Bas, M., Bol´ os, V.J.: Applying data driven decision making to rank vocational and educational training programs with topsis. Decision Support Systems 142, 113470 (2021)

    2021

  8. [16]

    International Journal of Applied Information Systems 4(8), 38–42 (2012)

    Ayman Al Ahmar, M.: A prototype rule-based expert system with an object- oriented database for university undergraduate major selection. International Journal of Applied Information Systems 4(8), 38–42 (2012)

    2012

  9. [17]

    Decision Sciences Journal of Innovative Education 11(1), 77–105 (2013)

    Kumar, A., Kumar, P.: An examination of factors influencing students selection of business majors using TRA framework. Decision Sciences Journal of Innovative Education 11(1), 77–105 (2013)

    2013

  10. [18]

    Applied Sciences 12(24), 12525 (2022)

    Zayed, Y., Salman, Y., Hasasneh, A.: A recommendation system for selecting the appropriate undergraduate program at higher education institutions using graduate student data. Applied Sciences 12(24), 12525 (2022)

    2022

  11. [19]

    Weiss, G., Chen, Y., Leeds, D.D.: A college major recommendation system

    Stein, S.A., M. Weiss, G., Chen, Y., Leeds, D.D.: A college major recommendation system. In: Proceedings of the 14th ACM Conference on Recommender Systems. RecSys ’20, pp. 640–644. Association for Computing Machinery, New York, NY, USA (2020)

    2020

  12. [20]

    In: International Joint Conference on Computa- tional Intelligence (IJCCI) (2019)

    Alghamdi, S., Alzhrani, N., Algethami, H.: Fuzzy-based recommendation system for university major selection. In: International Joint Conference on Computa- tional Intelligence (IJCCI) (2019)

    2019

  13. [21]

    In: Companion Proceedings of the Web Conference 2018, pp

    Obeid, C., Lahoud, I., El Khoury, H., Champin, P.-A.: Ontology-based recom- mender system in higher education. In: Companion Proceedings of the Web Conference 2018, pp. 1031–1034 (2018)

    2018

  14. [22]

    International Journal of Advanced Computer Science and Applications 7(3), 166–175 (2016)

    Al-Badarenah, A., Alsakran, J.: An automated recommender system for course selection. International Journal of Advanced Computer Science and Applications 7(3), 166–175 (2016)

    2016

  15. [23]

    In: Proceedings of the 10th ACM Conference on Recommender Systems, pp

    Elbadrawy, A., Karypis, G.: Domain-aware grade prediction and top-n course recommendation. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp. 183–190 (2016)

    2016

  16. [24]

    In: Proceedings of the International Conference on Web Intelligence, pp

    Jing, X., Tang, J.: Guess you like: course recommendation in MOOCs. In: Proceedings of the International Conference on Web Intelligence, pp. 783–789 (2017)

    2017

  17. [25]

    In: International Conference on Computer 32 Supported Education, vol

    Bakhshinategh, B., Spanakis, G., Zaiane, O., ElAtia, S.: A course recommender system based on graduating attributes. In: International Conference on Computer 32 Supported Education, vol. 2, pp. 347–354 (2017)

    2017

  18. [26]

    In: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, pp

    Pardos, Z.A., Jiang, W.: Designing for serendipity in a university course rec- ommendation system. In: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, pp. 350–359 (2020)

    2020

  19. [27]

    European Journal of Information Systems 25, 289–302 (2016)

    M¨ uller, O., Junglas, I., Brocke, J.v., Debortoli, S.: Utilizing big data analytics for information systems research: challenges, promises and guidelines. European Journal of Information Systems 25, 289–302 (2016)

    2016

  20. [28]

    Information Systems 112, 102131 (2023)

    Abdelrazek, A., Eid, Y., Gawish, E., Medhat, W., Hassan, A.: Topic modeling algorithms and applications: A survey. Information Systems 112, 102131 (2023)

    2023

  21. [29]

    International Journal of Modern Education and Computer Science 9(7), 50 (2017)

    Sharma, D., Kumar, B., Chand, S.: A survey on journey of topic modeling tech- niques from SVD to deep learning. International Journal of Modern Education and Computer Science 9(7), 50 (2017)

    2017

  22. [30]

    IEEE Transactions on Knowledge & Data Engineering 34(03), 1427–1445 (2022)

    Qiang, J., Qian, Z., Li, Y., Yuan, Y., Wu, X.: Short text topic modeling techniques, applications, and performance: A survey. IEEE Transactions on Knowledge & Data Engineering 34(03), 1427–1445 (2022)

    2022

  23. [31]

    In: Proceedings of the Seventeenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp

    Papadimitriou, C.H., Tamaki, H., Raghavan, P., Vempala, S.: Latent seman- tic indexing: A probabilistic analysis. In: Proceedings of the Seventeenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 159–168 (1998)

    1998

  24. [32]

    In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp

    Hofmann, T.: Probabilistic latent semantic indexing. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 50–57 (1999)

    1999

  25. [33]

    Journal of Machine Learning Research 3(Jan), 993–1022 (2003)

    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet Allocation. Journal of Machine Learning Research 3(Jan), 993–1022 (2003)

    2003

  26. [34]

    Advances in neural information processing systems 13, 535–541 (2000)

    Lee, D., Seung, H.S.: Algorithms for non-negative matrix factorization. Advances in neural information processing systems 13, 535–541 (2000)

    2000

  27. [35]

    arXiv 2008.09470 (2020)

    Angelov, D.: Top2Vec: Distributed Representations of Topics. arXiv 2008.09470 (2020)

    2020 arXiv

  28. [36]

    arXiv 2203.05794 (2022)

    Grootendorst, M.: BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv 2203.05794 (2022)

    2022 arXiv

  29. [37]

    arXiv 2004.07737 (2021)

    Bianchi, F., Terragni, S., Hovy, D., Nozza, D., Fersini, E.: Cross-lingual Contex- tualized Topic Models with Zero-shot Learning. arXiv 2004.07737 (2021)

    2021 arXiv

  30. [38]

    arXiv 1810.04805 (2019)

    Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv 1810.04805 (2019)

    2019 arXiv

  31. [39]

    arXiv 2103.00498 (2021)

    Zhao, H., Phung, D., Huynh, V., Jin, Y., Du, L., Buntine, W.: Topic Modelling Meets Deep Neural Networks: A Survey. arXiv 2103.00498 (2021)

    2021 arXiv

  32. [40]

    In: Proceedings of Third International Conference on Communication, Computing and Electronics Systems: ICCCES 2021, pp

    Basmatkar, P., Maurya, M.: An overview of contextual topic modeling using bidirectional encoder representations from transformers. In: Proceedings of Third International Conference on Communication, Computing and Electronics Systems: ICCCES 2021, pp. 489–504 (2022) 33

    2022

  33. [41]

    In: Computer Graphics Forum, vol

    Lee, H., Kihm, J., Choo, J., Stasko, J., Park, H.: iVisClustering: An interactive visual document clustering via topic modeling. In: Computer Graphics Forum, vol. 31, pp. 1155–1164 (2012). Wiley Online Library

    2012

  34. [42]

    SpringerPlus 5(1), 1–22 (2016)

    Liu, L., Tang, L., Dong, W., Yao, S., Zhou, W.: An overview of topic modeling and its current applications in bioinformatics. SpringerPlus 5(1), 1–22 (2016)

    2016

  35. [43]

    Journal of Business Economics89(3), 327–356 (2019)

    Reisenbichler, M., Reutterer, T.: Topic modeling in marketing: recent advances and research opportunities. Journal of Business Economics89(3), 327–356 (2019)

    2019

  36. [44]

    Materials Today: Proceedings 45, 5591–5596 (2021)

    Rani, S., Kumar, M.: Topic modeling and its applications in materials science and engineering. Materials Today: Proceedings 45, 5591–5596 (2021)

    2021

  37. [45]

    Frontiers in Sociology 7 (2022)

    Egger, R., Yu, J.: A topic modeling comparison between LDA, NMF, Top2Vec, and BERTopic to demystify twitter posts. Frontiers in Sociology 7 (2022)

    2022

  38. [46]

    Reliability Engineering & System Safety 224, 108522 (2022)

    Rose, R.L., Puranik, T.G., Mavris, D.N., Rao, A.H.: Application of structural topic modeling to aviation safety data. Reliability Engineering & System Safety 224, 108522 (2022)

    2022

  39. [47]

    Frontiers in Computer Science 3, 775368 (2021)

    Mishra, R.K., Urolagin, S., Jothi, J.A.A., Neogi, A.S., Nawaz, N.: Deep learning- based sentiment analysis and topic modeling on tourism during Covid-19 pandemic. Frontiers in Computer Science 3, 775368 (2021)

    2021

  40. [48]

    International Journal of Computer Applications 47(11), 44–50 (2012)

    Johnson, F., Gupta, S.K.: Web content mining techniques: A survey. International Journal of Computer Applications 47(11), 44–50 (2012)

    2012

  41. [49]

    In: Proceed- ings of the PAKDD 1999 Workshop on Knowledge Disocovery from Advanced Databases, vol

    Tan, A.-H.: Text mining: The state of the art and the challenges. In: Proceed- ings of the PAKDD 1999 Workshop on Knowledge Disocovery from Advanced Databases, vol. 8, pp. 65–70 (1999)

    1999

  42. [50]

    Business & Information Systems Engineering 63(6), 711–732 (2021)

    F¨ oll, P., Thiesse, F.: Exploring information systems curricula: a text mining approach. Business & Information Systems Engineering 63(6), 711–732 (2021)

    2021

  43. [51]

    (eds.): Recommender Systems Handbook, 3rd edn

    Ricci, F., Rokach, L., Shapira, B. (eds.): Recommender Systems Handbook, 3rd edn. Springer, ??? (2022)

    2022

  44. [52]

    Information Systems 94, 101582 (2020)

    Vayansky, I., Kumar, S.A.: A review of topic modeling methods. Information Systems 94, 101582 (2020)

    2020

  45. [53]

    an application of BERTopic and zero-shot text classification

    Moreno, M.R., S´ anchez-Franco, M.J., Tienda, M.D.l.S.R.: Examining transaction- specific satisfaction and trust in airbnb and hotels. an application of BERTopic and zero-shot text classification. Tourism & Management Studies 19(2), 21–37 (2023)

    2023

  46. [54]

    NPJ Digital Medicine 6(1), 115 (2023)

    Uncovska, M., Freitag, B., Meister, S., Fehring, L.: Rating analysis and BERTopic modeling of consumer versus regulated mHealth app reviews in Germany. NPJ Digital Medicine 6(1), 115 (2023)

    2023

  47. [55]

    Applied Sciences 13(2), 797 (2023)

    Ogunleye, B., Maswera, T., Hirsch, L., Gaudoin, J., Brunsdon, T.: Comparison of topic modelling approaches in the banking context. Applied Sciences 13(2), 797 (2023)

    2023

  48. [56]

    In: Proceedings of NAACL- HLT, vol

    Kenton, J.D.M.-W.C., Toutanova, L.K.: BERT: Pre-training of Deep Bidirec- tional Transformers for Language Understanding. In: Proceedings of NAACL- HLT, vol. 1, p. 2 (2019). Minneapolis, Minnesota 34

    2019

  49. [57]

    In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp

    Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al.: Transformers: State-of-the-art Natu- ral Language Processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing:...

    2020

  50. [58]

    Accessed 20 August 2024 from www.crummy.com/software/BeautifulSoup/bs4/doc (n.d.)

    Richardson, L.: Beautiful Soup Documentation. Accessed 20 August 2024 from www.crummy.com/software/BeautifulSoup/bs4/doc (n.d.)

    2024

  51. [59]

    O’Reilly Media, Inc., ??? (2009)

    Bird, S., Klein, E., Loper, E.: Natural Language Processing with Python. O’Reilly Media, Inc., ??? (2009)

    2009

  52. [60]

    Journal of Machine Learning Research 12, 2825–2830 (2011)

    Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: Machine learning in Python. Journal of Mach...

    2011

  53. [61]

    Accessed 20 August 2024 from github.com/amueller/word cloud (2009)

    Mueller, A.C.: Word Cloud Generator in Python. Accessed 20 August 2024 from github.com/amueller/word cloud (2009)

    2009

  54. [62]

    User Modeling and User-Adapted Interaction 31, 591–627 (2020)

    Tsai, C.-H., Brusilovsky, P.: The effects of controllability and explainability in a social recommender system. User Modeling and User-Adapted Interaction 31, 591–627 (2020)

    2020

  55. [63]

    In: Recommender Systems Handbook, pp

    Tintarev, N., Masthoff, J.: Explaining recommendations: Design and evaluation. In: Recommender Systems Handbook, pp. 353–382. Springer, Boston, MA, USA (2015)

    2015

  56. [64]

    ACM Transactions on Intelligent Systems and Technology 14(5) (2023)

    Li, Y., Chen, H., Xu, S., Ge, Y., Tan, J., Liu, S., Zhang, Y.: Fairness in rec- ommendation: Foundations, methods, and applications. ACM Transactions on Intelligent Systems and Technology 14(5) (2023)

    2023

  57. [65]

    The VLDB Journal 31, 431–458 (2022)

    Pitoura, E., Stefanidis, K., Koutrika, G.: Fairness in rankings and recommenda- tions: an overview. The VLDB Journal 31, 431–458 (2022)

    2022

  58. [66]

    User Modeling and User-Adapted Interaction, 1–50 (2023)

    Deldjoo, Y., Jannach, D., Bellogin, A., Difonzo, A., Zanzonelli, D.: Fairness in recommender systems: research landscape and future directions. User Modeling and User-Adapted Interaction, 1–50 (2023)

    2023

  59. [67]

    In: Ricci, F., Rokach, L., Shapira, B

    Ekstrand, M.D., Das, A., Burke, R., Diaz, F.: Fairness in recommender systems. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 679–707. Springer, New York, NY, USA (2022)

    2022

  60. [68]

    arXiv 2010.03240 (2021)

    Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., He, X.: Bias and Debias in Recommender System: A Survey and Future Directions. arXiv 2010.03240 (2021)

    2021 arXiv

  61. [69]

    In: Ramzan, N., Zwol, R., Lee, J.-S., Cl¨ uver, K., Hua, X.-S

    Jeckmans, A.J.P., Beye, M., Erkin, Z., Hartel, P., Lagendijk, R.L., Tang, Q.: Privacy in recommender systems. In: Ramzan, N., Zwol, R., Lee, J.-S., Cl¨ uver, K., Hua, X.-S. (eds.) Social Media Retrieval, pp. 263–281. Springer, London (2013)

    2013

  62. [70]

    arXiv 2208.06265 (2023) 35

    Wang, S., Zhang, X., Wang, Y., Liu, H., Ricci, F.: Trustworthy Recommender Systems. arXiv 2208.06265 (2023) 35

    2023 arXiv

Pith tools