Graduate School of Informatics /Information Systems

In partial fulfillment of the requirements for the degree of Master of Science Fatih Kurt will defend his thesis.

Title: "ONTOLOGY GUIDED NEURAL NETWORK PROCESSING FOR AUTOMATIC IMAGE CAPTION GENERATION" 

Date: 24th January 2018

Time: 10:00 AM

Place: A-212

Thesis Abstract :

A fundamental problem in artificial intelligence is automatically describing the content of an image since it will help to identify objects with computer vision and create meaningful rich descriptions using natural language processing. At the same time, searching for an image with a description is another key element in proving theory work vice versa. In this work, ontology guided neural network processing will be used to further improve previous work regarding to image caption generation. By using ontology, more reliable results could be deducted from neural network processing by associating objects and their activities with vector results. Final trained system is expected to better process visual input and create better descriptions for images by also using RNNs(recurrent neural networks); thus, the work is aimed at further improving BLEU score of earlier works.