Development of a System for Strategic Surveillance of Social Networks and Digital Press Media using Web Scraping
Abstract
The “Tyche” research program has the objective of creating a tool environment to carry out activities that facilitate the tasks of Strategic Surveillance. At present, the ADA laboratory of the Systems Engineering Faculty (FIS) of the EPN is executing several integrating projects distributed in different phases. The present integrative project is within the third phase called "Information Collection". The objective of the project is to develop an automated information collection system, optimizing search times and reducing information overload. This search will be done on digital media and social networks (Twitter, Facebook, Instagram, and LinkedIn). In addition, the purpose is also to obtain information that is easy to interpret, generates knowledge, and contributes to the organizations that use Strategic Surveillance.
The degree work is developed under the agile Scrum methodology that will allow partial deliveries of the product incrementally and iteratively, which will help developers to perform the division of tasks and allocation of work time. The system is based on the MVC pattern (Model - View - Controller). The Model part corresponds to Prisma which, is a GraphQL database connection. On the other hand, the Controller has been developed in Python together with the implementation of libraries, frameworks, and APIs, while the View which, is the interaction with the user was developed in the Angular framework and written in TypeScript. programming language.
The developed system was evaluated by the Technology Acceptance Model (TAM). The evaluation showed that more than 80% of the participants considered the system to be easy to use, and 100% perceived it to be useful for the collection of information from social networks and digital media. It is concluded that although there are improvements that can be made to the system, it fulfills its objective.
Downloads
References
F. J. Aguilar. Scanning the business environment. New York, USA: Macmillan, 1967.
H. Lesca, and N. Lesca. Weak signals for strategic intelligence: anticipation tool for managers, London, UK: ISTE-Wiley, 2011.
E. Loza-Aguirre, and A. Buitrago, “Qualitative assessment of user acceptance within Action Design Research and Action Research: two case studies,” Latin American Journal of Computing, vol. 1, no. 1, pp. 12-12 , 2014.
A. Carbonell Martínez, “Vigilancia tecnológica e inteligencia competitiva al servicio de la innovación,” Universitat Politècnica de València, España, 2019.
CMI Gestión, “Vigilancia Estratégica como ventaja competitiva,” [Online]. Available: https://cmigestion.es/2017/03/07/vigilancia-estrategica-como-ventaja-competitiva/. [Accessed: Mar.16, 2021].
CIDEI, “Vigilancia Estratégica,” [Online].Available: http://cidei.net/vigilancia-estrategica/ [Accessed: Mar.07, 2021].
A. Carbonell Martínez, “Vigilancia tecnológica e inteligencia competitiva al servicio de la innovación. 3C Tecnología.,”Glosas de innovación aplicadas a la pyme, vol. 8(4), pp. 61-69, 2019.
Antevenio, “Qué es el web scraping, para qué sirve y como suele utilizarse,” . (2021). [Online]. Available: https://www.antevenio.com/blog/2019/03/que-es-el-web-scraping-y-para-que-sirve/ [Accessed: Mar.20 , 2021].
IONOS Digitalguide, “¿Qué es el web scraping?,” [Online]. Available: https://www.ionos.es/digitalguide/paginas-web/desarrollo-web/que-es-el-web-scraping/ [Accessed: Jul.26, 2021].
MINTIC, “¿Qué es web scraping? Curso de Python,” [Online]. Available: https://mintic.platzi.com/clases/1698-mintic-python/7118-que-es-web-scrapi-6/ [Accessed: Abr.04 , 2021].
A. Visus,“¿Para qué sirve Python? Razones para utilizar este lenguajede programación,” Esic Business & Marketing School. [Online]. Available: https://www.esic.edu/rethink/tecnologia/para-que-sirve-python [Accessed: Abr.10, 2021].
A. Lafuente, “Qué es el web scraping,” Aukera. [Online]. Available: https://aukera.es/blog/web-scraping/ [Accessed: Abr.18, 2021].
D. Leyton, “Extensión al Modelo de Aceptación de Tecnología TAM,”Repositorio uchile.cl, 2013.
V. Del Campo, and F. Scholborgh, “Modelo de Aceptación Tecnológica (TAM),” Revista Espacios, vol. 41, no. 37, pp. 159-171, 2020.
J. Yong, J. Rivas and J. Chaparro, “Modelo de aceptación tecnológica (TAM): un estudio de la influencia de la cultura nacional y del perfil del usuario en el uso de las TIC,” Sistema de Información Científica Redalyc, Red de Revistas Científicas, Colombia, 2009.
J. J. Diaz Ortiz, and M. A. Romero Suarez, “Desarrollo e implementación de un aplicativo web, utilizando la metodología Scrum, para mejorar el proceso de atención al cliente en la empresa Z Aditivos SA,” 2017.
M. Trigás Gallego, “Metodología Scrum,” 2012
G. Mancuzo,“Fases de la Metodología Scrum”. ComparaSoftware Blog, 2020.
Softeng, “Proceso y Roles de Scrum,” [Online]. Available: https://www.softeng.es/es-es/empresa/metodologias-de-trabajo/metodologia-scrum/proceso-roles-de-scrum.html [Accessed: May.05, 2020].
This article is published by LAJC under a Creative Commons Attribution-Non-Commercial-Share-Alike 4.0 International License. This means that non-exclusive copyright is transferred to the National Polytechnic School. The Author (s) give their consent to the Editorial Committee to publish the article in the issue that best suits the interests of this Journal. Find out more in our Copyright Notice.
Disclaimer
LAJC in no event shall be liable for any direct, indirect, incidental, punitive, or consequential copyright infringement claims related to articles that have been submitted for evaluation, or published in any issue of this journal. Find out more in our Disclaimer Notice.