Towards brain-activity-controlled information retrieval: decoding image relevance from MEG signals

We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kauppi, Jukka-Pekka (VerfasserIn) , Kandemir, Melih (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 13 January 2015
In: NeuroImage
Year: 2015, Jahrgang: 112, Pages: 288-298
ISSN:1095-9572
DOI:10.1016/j.neuroimage.2014.12.079
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.neuroimage.2014.12.079
Verlag, lizenzpflichtig, Volltext: http://www.sciencedirect.com/science/article/pii/S1053811915000026
Volltext
Verfasserangaben:Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski

MARC

LEADER 00000caa a2200000 c 4500
001 1703815394
003 DE-627
005 20220818142744.0
007 cr uuu---uuuuu
008 200707s2015 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.neuroimage.2014.12.079  |2 doi 
035 |a (DE-627)1703815394 
035 |a (DE-599)KXP1703815394 
035 |a (OCoLC)1341344628 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Kauppi, Jukka-Pekka  |e VerfasserIn  |0 (DE-588)1213320852  |0 (DE-627)1703873033  |4 aut 
245 1 0 |a Towards brain-activity-controlled information retrieval  |b decoding image relevance from MEG signals  |c Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski 
264 1 |c 13 January 2015 
300 |a 11 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 07.07.2020 
520 |a We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were viewing image collages, a subset of which was relevant to a predetermined task. We report three findings: i) the relevance of an image a subject looks at can be decoded from MEG signals with performance significantly better than chance, ii) fusion of gaze-based and MEG-based classifiers significantly improves the prediction performance compared to using either signal alone, and iii) non-linear classification of the MEG signals using Gaussian process classifiers outperforms linear classification. These findings break new ground for building brain-activity-based interactive image retrieval systems, as well as for systems utilizing feedback both from brain activity and eye movements. 
650 4 |a Bayesian classification 
650 4 |a Gaussian processes 
650 4 |a Gaze signal 
650 4 |a Image relevance 
650 4 |a Implicit relevance feedback 
650 4 |a Information retrieval 
650 4 |a Magnetoencephalography 
700 1 |a Kandemir, Melih  |d 1983-  |e VerfasserIn  |0 (DE-588)1067700463  |0 (DE-627)819103551  |0 (DE-576)426867181  |4 aut 
773 0 8 |i Enthalten in  |t NeuroImage  |d Orlando, Fla. : Academic Press, 1992  |g 112(2015), Seite 288-298  |h Online-Ressource  |w (DE-627)268125503  |w (DE-600)1471418-8  |w (DE-576)106869507  |x 1095-9572  |7 nnas  |a Towards brain-activity-controlled information retrieval decoding image relevance from MEG signals 
773 1 8 |g volume:112  |g year:2015  |g pages:288-298  |g extent:11  |a Towards brain-activity-controlled information retrieval decoding image relevance from MEG signals 
856 4 0 |u https://doi.org/10.1016/j.neuroimage.2014.12.079  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u http://www.sciencedirect.com/science/article/pii/S1053811915000026  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20200707 
993 |a Article 
994 |a 2015 
998 |g 1067700463  |a Kandemir, Melih  |m 1067700463:Kandemir, Melih  |d 700000  |d 708070  |e 700000PK1067700463  |e 708070PK1067700463  |k 0/700000/  |k 1/700000/708070/  |p 2 
999 |a KXP-PPN1703815394  |e 3696042757 
BIB |a Y 
SER |a journal 
JSO |a {"title":[{"title":"Towards brain-activity-controlled information retrieval","subtitle":"decoding image relevance from MEG signals","title_sort":"Towards brain-activity-controlled information retrieval"}],"person":[{"role":"aut","display":"Kauppi, Jukka-Pekka","roleDisplay":"VerfasserIn","given":"Jukka-Pekka","family":"Kauppi"},{"given":"Melih","family":"Kandemir","role":"aut","display":"Kandemir, Melih","roleDisplay":"VerfasserIn"}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Gesehen am 07.07.2020"],"recId":"1703815394","language":["eng"],"origin":[{"dateIssuedDisp":"13 January 2015","dateIssuedKey":"2015"}],"id":{"doi":["10.1016/j.neuroimage.2014.12.079"],"eki":["1703815394"]},"name":{"displayForm":["Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski"]},"physDesc":[{"extent":"11 S."}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"origin":[{"dateIssuedDisp":"[1992]-","publisher":"Academic Press","publisherPlace":"Orlando, Fla."}],"id":{"issn":["1095-9572"],"zdb":["1471418-8"],"eki":["268125503"]},"note":["Fortsetzung der Druck-Ausgabe","Gesehen am 29.06.20"],"disp":"Towards brain-activity-controlled information retrieval decoding image relevance from MEG signalsNeuroImage","type":{"media":"Online-Ressource","bibl":"periodical"},"recId":"268125503","language":["eng"],"pubHistory":["Volume 1, issue 1 (august 1992)-"],"part":{"text":"112(2015), Seite 288-298","volume":"112","extent":"11","year":"2015","pages":"288-298"},"title":[{"title_sort":"NeuroImage","title":"NeuroImage","subtitle":"a journal of brain function"}]}]} 
SRT |a KAUPPIJUKKTOWARDSBRA1320