Towards brain-activity-controlled information retrieval: decoding image relevance from MEG signals
We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were...
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
13 January 2015
|
| In: |
NeuroImage
Year: 2015, Jahrgang: 112, Pages: 288-298 |
| ISSN: | 1095-9572 |
| DOI: | 10.1016/j.neuroimage.2014.12.079 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.neuroimage.2014.12.079 Verlag, lizenzpflichtig, Volltext: http://www.sciencedirect.com/science/article/pii/S1053811915000026 |
| Verfasserangaben: | Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1703815394 | ||
| 003 | DE-627 | ||
| 005 | 20220818142744.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 200707s2015 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.neuroimage.2014.12.079 |2 doi | |
| 035 | |a (DE-627)1703815394 | ||
| 035 | |a (DE-599)KXP1703815394 | ||
| 035 | |a (OCoLC)1341344628 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Kauppi, Jukka-Pekka |e VerfasserIn |0 (DE-588)1213320852 |0 (DE-627)1703873033 |4 aut | |
| 245 | 1 | 0 | |a Towards brain-activity-controlled information retrieval |b decoding image relevance from MEG signals |c Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski |
| 264 | 1 | |c 13 January 2015 | |
| 300 | |a 11 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 07.07.2020 | ||
| 520 | |a We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were viewing image collages, a subset of which was relevant to a predetermined task. We report three findings: i) the relevance of an image a subject looks at can be decoded from MEG signals with performance significantly better than chance, ii) fusion of gaze-based and MEG-based classifiers significantly improves the prediction performance compared to using either signal alone, and iii) non-linear classification of the MEG signals using Gaussian process classifiers outperforms linear classification. These findings break new ground for building brain-activity-based interactive image retrieval systems, as well as for systems utilizing feedback both from brain activity and eye movements. | ||
| 650 | 4 | |a Bayesian classification | |
| 650 | 4 | |a Gaussian processes | |
| 650 | 4 | |a Gaze signal | |
| 650 | 4 | |a Image relevance | |
| 650 | 4 | |a Implicit relevance feedback | |
| 650 | 4 | |a Information retrieval | |
| 650 | 4 | |a Magnetoencephalography | |
| 700 | 1 | |a Kandemir, Melih |d 1983- |e VerfasserIn |0 (DE-588)1067700463 |0 (DE-627)819103551 |0 (DE-576)426867181 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t NeuroImage |d Orlando, Fla. : Academic Press, 1992 |g 112(2015), Seite 288-298 |h Online-Ressource |w (DE-627)268125503 |w (DE-600)1471418-8 |w (DE-576)106869507 |x 1095-9572 |7 nnas |a Towards brain-activity-controlled information retrieval decoding image relevance from MEG signals |
| 773 | 1 | 8 | |g volume:112 |g year:2015 |g pages:288-298 |g extent:11 |a Towards brain-activity-controlled information retrieval decoding image relevance from MEG signals |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.neuroimage.2014.12.079 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u http://www.sciencedirect.com/science/article/pii/S1053811915000026 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20200707 | ||
| 993 | |a Article | ||
| 994 | |a 2015 | ||
| 998 | |g 1067700463 |a Kandemir, Melih |m 1067700463:Kandemir, Melih |d 700000 |d 708070 |e 700000PK1067700463 |e 708070PK1067700463 |k 0/700000/ |k 1/700000/708070/ |p 2 | ||
| 999 | |a KXP-PPN1703815394 |e 3696042757 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"title":[{"title":"Towards brain-activity-controlled information retrieval","subtitle":"decoding image relevance from MEG signals","title_sort":"Towards brain-activity-controlled information retrieval"}],"person":[{"role":"aut","display":"Kauppi, Jukka-Pekka","roleDisplay":"VerfasserIn","given":"Jukka-Pekka","family":"Kauppi"},{"given":"Melih","family":"Kandemir","role":"aut","display":"Kandemir, Melih","roleDisplay":"VerfasserIn"}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Gesehen am 07.07.2020"],"recId":"1703815394","language":["eng"],"origin":[{"dateIssuedDisp":"13 January 2015","dateIssuedKey":"2015"}],"id":{"doi":["10.1016/j.neuroimage.2014.12.079"],"eki":["1703815394"]},"name":{"displayForm":["Jukka-Pekka Kauppi, Melih Kandemir, Veli-Matti Saarinen, Lotta Hirvenkari, Lauri Parkkonen, Arto Klami, Riitta Hari, Samuel Kaski"]},"physDesc":[{"extent":"11 S."}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"origin":[{"dateIssuedDisp":"[1992]-","publisher":"Academic Press","publisherPlace":"Orlando, Fla."}],"id":{"issn":["1095-9572"],"zdb":["1471418-8"],"eki":["268125503"]},"note":["Fortsetzung der Druck-Ausgabe","Gesehen am 29.06.20"],"disp":"Towards brain-activity-controlled information retrieval decoding image relevance from MEG signalsNeuroImage","type":{"media":"Online-Ressource","bibl":"periodical"},"recId":"268125503","language":["eng"],"pubHistory":["Volume 1, issue 1 (august 1992)-"],"part":{"text":"112(2015), Seite 288-298","volume":"112","extent":"11","year":"2015","pages":"288-298"},"title":[{"title_sort":"NeuroImage","title":"NeuroImage","subtitle":"a journal of brain function"}]}]} | ||
| SRT | |a KAUPPIJUKKTOWARDSBRA1320 | ||