Advanced search
Start date
Betweenand

Déjà vu: feature-space-time coherence from heterogeneous data for media integrity analytics and interpretation of events

Grant number: 17/12646-3
Support type:Research Projects - Thematic Grants
Duration: December 01, 2017 - November 30, 2022
Field of knowledge:Physical Sciences and Mathematics - Computer Science
Principal Investigator:Anderson de Rezende Rocha
Grantee:Anderson de Rezende Rocha
Home Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas, SP, Brazil
Co-Principal Investigators:Hélio Pedrini
Assoc. researchers: Adam Maciej Czajka ; Alexandre Mello Ferreira ; André Carlos Ponce de Leon Ferreira de Carvalho ; Eduardo Alves do Valle Junior ; Edward John Delp III ; Fernanda Alcântara Andaló ; Gerberth Adín Ramírez Rivera ; Jacques Wainer ; Kevin Wilson Bowyer ; Kot Chi Chung Alex ; Lin Tzy Li ; Marcos André Gonçalves ; Paolo Bestagini ; Patrick Joseph Flynn ; Sandra Eliza Fontes de Avila ; Stefano Tubaro ; Walter Jerome Scheirer ; William Robson Schwartz ; Zanoni Dias
Associated scholarship(s):18/05668-3 - Feature-space-time coherence with heterogeneous data, BP.PD

Abstract

In this research project, we focus on synchronizing specific events in space and time (X-coherence), fact-checking, and mining persons, objects and contents of interest from various and heterogeneous sources including - but not limited to - the internet, social media and surveillance imagery. For that, we seek to harness information from various media sources and synchronize the multiple textual and visual information pieces around the position of an event or object as well as order them so as to allow a better understanding about what happened before, during, and shortly after the event. After automatically organizing the data and understanding the order of the facts, we can devise and deploy solutions for mining persons or objects of interest for suspect analysis/tracking, fact checking, or even understanding the nature of the said event. Additionally, by exploring the possible existing links among different pieces of information, we aim at further designing and developing media integrity analytics tools to hint at existing forgeries, sensitive content (e.g., violent content, child pornography), and spreading patterns of multimedia objects online. With demanding and sophisticated crimes and terrorist threats becoming ever more pervasive, allied with the advent and spread of fake news, our objective is to use the developed solutions to help us answering the four most important questions in forensics regarding an event: "who," "in what circumstances," "why," and "how," thus identifying the characteristics and circumstances in which an event has taken place. (AU)

Scientific publications (5)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
LI, HAOLIANG; HE, PEISONG; WANG, SHIQI; ROCHA, ANDERSON; JIANG, XINGHAO; KOT, ALEX C. Learning Generalized Deep Feature Representation for Face Anti-Spoofing. IEEE Transactions on Information Forensics and Security, v. 13, n. 10, p. 2639-2652, OCT 2018. Web of Science Citations: 0.
AMORIM, PAULO; MORAES, THIAGO; FAZANARO, DALTON; SILVA, JORGE; PEDRINI, HELIO. Shearlet and contourlet transforms for analysis of electrocardiogram signals. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, v. 161, p. 125-132, JUL 2018. Web of Science Citations: 0.
SOUZA, MARCOS R.; PEDRINI, HELIO. Digital video stabilization based on adaptive camera trajectory smoothing. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, MAY 30 2018. Web of Science Citations: 0.
VITORINO, PAULO; AVILA, SANDRA; PEREZ, MAURICIO; ROCHA, ANDERSON. Leveraging deep neural networks to fight child pornography in the age of social media. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 50, p. 303-313, JAN 2018. Web of Science Citations: 0.
CORDOVA NEIRA, MANUEL ALBERTO; MENDES JUNIOR, PEDRO RIBEIRO; ROCHA, ANDERSON; TORRES, RICARDO DA SILVA. Data-Fusion Techniques for Open-Set Recognition Problems. IEEE ACCESS, v. 6, p. 21242-U24, 2018. Web of Science Citations: 0.

Please report errors in scientific publications list by writing to: cdi@fapesp.br.
Distribution map of accesses to this page
Click here to view the access summary to this page.