AUTOMATION OF FACT-CHECKING IN JOURNALISM: LIMITATIONS AND PROSPECTS FOR DEVELOPMENT

UDC 070

  • Igor Korolev − Senior Lecturer, PhD student, the Department of Medialogy. Belarusian State University (4, Nezavisimosti Ave., 220030, Minsk, Republic of Belarus). E-mail: iakorolev1996@gmail.com

DOI: https://doi.org/10.52065/2520-6729-2022-261-2-50-56

Keywords: fact-checking, fact-checking automation, fact-checking automation systems, checkworthy claims, fake news.

For citation: I. Korolev. Automation of fact-checking in journalism: limitations and prospects for development. Proceedings of BSTU, issue 4, Print- and Mediatechnology, 2022, no. 2 (261), pp. 50–56 (In Russian). DOI: https://doi.org/10.52065/2520-6729-2022-261-2-50-56.

Abstract

Widespread technical and social mediatization has led to a significant increase of unverified information (including fake news) circulating in the media space. One of the ways to overcome the problem of deficit of resources for media editorial offices for high-quality and efficient processing of increased volume of unverified information is to automate the process of establishing the reliability of facts/factual claims (fact-checking). Based on the analysis of six popular automated fact-checking systems (“ClaimBuster”, “ClaimPortal”, “Squash”, “AFCNR”, “Full Fact” and “Context-Aware”), the article reveals the basic principles and algorithms of the functioning similar systems, as well as the limitations and prospects for the development of this field of journalism automation.

Download

References

  1. Vosoughi S., Roy D., Aral S. The spread of true and false news online. Science, 2018, vol. 359, no. 6380, pp. 1146–1151. DOI: 10.1126/science.aap9559.
  2. Hassan N., Adair B., Hamilton J., Li Ch., Tremayne M., Yang J., Yu C. The Quest to Automate Fact-Checking. Available at: http://cj2015.brown.columbia.edu/papers/automate-fact-checking.pdf (accessed 28.02.2022).
  3. Majithia S., Arslan F., Lubal S., Jimenez D., Arora P., Caraballo J., Li Ch. ClaimPortal: Integrated Monitoring, Searching, Checking, and Analytics of Factual Claims on Twitter. Available at: https://aclanthology.org/P19-3026.pdf (accessed 28.02.2022).
  4. Nakov P., Corney D., Hasanain M., Alam F., Elsayed T., Barron-Cedeno A., Papotti P., Shaar Sh., Da San Martino G. Automated Fact-Checking for Assisting Human Fact-Checkers. Available at: https://arxiv.org/pdf/2103.07769.pdf (accessed 28.02.2022).
  5. The Challenges of Online Fact Checking. Available at: https://fullfact.org/media/uploads/coof-2020.pdf (accessed 16.02.2022).
  6. Cohen S., Li Ch., Yang J., Yu C. Computational journalism: A Call to Arms to Database Researchers. Online Proceedings, 2011, pp. 148–151. Available at: https://www.researchgate.net/publication/220988205_Computational_Journalism_A_Call_to_Arms_to_Database_Researchers (accessed 28.02.2022).
  7. Ivanov A. D. The Robotic Journalism and the first algorithms on service of editions of the international mass media. Znak: problemnoe pole mediaobrazovaniya [Sign: the problem field of media education], 2015, no. 2 (16), pp. 32–40 (In Russian).
  8. Hassan N., Zhang G., Arslan F., Caraballo J., Jimenez D., Gawsane S., Hasan Sh., Joseph M., Kulkarni A., Kumar Nayak A., Sable A., Li Ch., Tremayne M. ClaimBuster: the First-ever End-to-end Fact-Checking System. Available at: https://vldb.org/pvldb/vol10/p1945-li.pdf (accessed 28.02.2022).
  9. ClaimBuster. Automated Live Fact-Checking. Available at: https://idir.uta.edu/claimbuster (accessed 28.02.2022).
  10. ClaimPortal. Available at: https://idir.uta.edu/claimportal (accessed 28.02.2022).
  11. Rauch J. Fact-Checking the President in Real Time. Available at: https://www.theatlantic.com/magazine/rchive/2019/06/fact-checking-donald-trump-ai/588028 (accessed 28.02.2022).
  12. Adair B. The lessons of Squash, Duke’s automated fact-checking platform. Available at: https://www.poynter.org/fact-checking/2021/the-lessons-of-squash-the-first-automated-fact-checking-platform/ (accessed 28.02.2022).
  13. Miranda S., Nogueira D., Mendes A., Vlachos A., Secker A., Garrett R., Mitchel J., Marino Z. Automated Fact Checking in the News Room. The World Wide Web Conference. New York, 2019, pp. 3579–3583. DOI: 10.1145/3308558.3314135.
  14. Fact Checking Demo on Journalistic Corpus. Available at: https://vimeo.com/309336679 (accessed 28.02.2022).
  15. Hassan N., Li Ch., Arslan F., Tremayne M. Toward Automated Fact-Checking: Detecting Check-Worthy Factual Claims by ClaimBuster. New York, 2017, pp. 1803–1812. DOI: 10.1145/3097983.3098131.
  16. Gencheva P., Nakov P., Marquez L., Barron-Cedeno A., Koychev I. A Context-Aware Approach for Detecting Worth-Checking Claims in Political Debates. Varna, 2017, pp. 267–276. DOI: 10.26615/978-954-452-049-6_037.
11.03.2022