User Study

To evaluate Explain-a-LOD, we have conducted a user study with 18 participants. Each participant was asked to rate the following 75 hypotheses. The following tables show the hypotheses along with the users' average rating (1=lowest, 5=highest).

Data Set 1 - Corruption Perceptions Index

Hypothesis	Average Rating
Countries that belong to the least developed countries have high corruption.	4.33
Countries where military conflicts are carried out and where no radio stations and schools exist have high corruption.	4.28
African countries have high corruption.	4.06
Countries with a high HDI (Human Development Index) have low corruption.	4
EU member states have low corruption.	3.83
Countries without schools where at most one company has been founded have high corruption.	3.78
OECD member states have low corruption.	3.65
Member states of the African Union have high corruption.	3.65
Countries with an HDI (Human Development Index) less than 0.712 have high corruption.	3.39
Countries where no cultural events take place and no companies exist have high corruption.	3.39
Countries that have never carried out major sports events and do not have a national team for any sports have high corruption.	3.11
Countries where many products originate from have low corruption.	2.94
Countries divided into at least five organizational units where at least three ethnic or religious tribes live have high corruption.	2.89
Countries with an HDI (Human Development Index) less than 0.677 that do not have a national team for any sports have high corruption.	2.88
Countries with a high latitude have low corruption.	2.83
Countries where at most one organization has been founded have high corruption.	2.78
Countries where radio stations are available have low corruption.	2.72
Countries with many important things (such as landmarks, companies, etc.) have low corruption.	2.71
Countries where at least eight languages are spoken have high corruption.	2.5
Countries that are very wide have high corruption.	2.33
Countries where no organizations exist and no bands or musicians originate have high corruption.	2.33
Countries where concerts take place have low corruption.	2.22
Countries that are the headquarters of many helicopter airlines have low corruption.	2.11
Countries with many leaders who are knights of the elephant have low corruption.	2
Countries larger than 143.000 km² with a logitude larger than 28 have high corruption.	2
Countries where no organizations exist except for muslim communities, and where famous persons have been born have high corruption.	2
Countries with at most 84 important things (such as landmarks, companies, etc.), where at least seven languages or dialects are spoken, and which have withdrawn candidates from at most beauty contests have high corruption.	1.94
Countries where candidates have not competed in beauty contests more than once have high corruption.	1.94
Countries with at most 30 important things (such as landmarks, companies, etc.) where the official language is not a language also spoken in Botswana have high corruption.	1.89
Countries whose international calling code is higher than 221 have high corruption.	1.83
Countries for which fighers (e.g., boxers) start at turnaments have low corruption.	1.78
Countries whose name stands for at most 30 things and that do not have a national team for any sports have high corruption.	1.78
Countries where many music groups founded in 2004 originate have low corruption.	1.67
Countries where candidates have not competed in beauty contests more than once and where more than 35 larger cities exist have high corruption.	1.67
Countries where many famous persons have been born have high corruption.	1.56
Countries with many websites about that country have high corruption.	1.5
Countries with many mountains have low corruption.	1.39
Countries where music groups originate that have been disbanded in 2008 have low corruption.	1.28

Intra-class correlation coefficient: 0.9044

Data Set 2 - Quality of Living

Hypothesis	Average Rating
Cities where events (e.g., concerts) take place have a high quality of living.	3.94
European capitals of culture have a high quality of living.	3.89
African capitals have a low quality of living.	3.89
Host cities of olympic summer games have a high quality of living.	3.78
Cities with at least 73 important things (e.g., landmarks) have a high quality of living.	3.56
Cities in OECD member states have a high quality of living.	3.5
Cities where many products originate have a high quality of living.	3.44
Cities that are the headquarter of many organizations have a high quality of living.	3.12
Cities where major sports events take place have a high quality of living.	3.11
Cities that are the headquarter of many things (such as companies) have a high quality of living.	3.11
Cities with a latitude larger than 34 and a longitude lower than 15 have a high quality of living.	3.06
Cities with a large population have a low quality of living.	3.06
Cities with many things (such as comanies, landmarks, ...) nearby have a high quality of living.	3.06
Cities with a large latitude have a high quality of living.	2.89
Cities that are the hometown of at least 13 organizations have a high quality of living.	2.78
Cities where at least 33 artists or bands come from have a high quality of living.	2.72
Cities that are the hometown of at least 12 bands and that have at most 400,000 inhabitants have a high quality of living.	2.67
Cities that are not warmer than 21°C in May have a high quality of living.	2.5
Cities where something (e.g., CDs) has been recorded and where (famous) persons have been born have a high quality of living.	2.39
Cities where something (e.g., CDs) has been recorded have a high quality of living.	2.28
Cities where many bands from the 2000s originate have a high quality of living.	2.22
Cities with less than 645,169 inhabitants and an area less than 335km² have a high quality of living.	2.22
Cities whose name also stands for other things have a high quality of living.	2.17
Cities from which fighters (e.g., boxers) start at matches have a high quality of living.	2.0
Cities where at least eight organizations, but at most 30 universities and at most six stadiums are located have a high quality of living.	1.89
Cities that lie in many OECD member states (sic!) have a high quality of living.	1.86
Cities where many bands founded in 2004 originate have a high quality of living.	1.83
Cities where something (e.g., CDs) has been recorded, where radio stations are available, and where no soccer players have scored a goal in an international match, have a high quality of living.	1.78
Cities that are not capitals have a high quality of living.	1.78
Cities where music has been recorded, but that are not capitals, have a high quality of living.	1.78
Cities where events take place and where no university is located have a high quality of living.	1.67
Cities that are populated areas have a high quality of living.	1.59
Cities that are the headquarter of at least eleven organizations and that are not a headquarter of an airline founded in 2006 have a high quality of living.	1.56
Cities with a high longitude have a high quality of living.	1.56
Cities where at least one album has been recorded and where at most 22 companies or organizations have there headquarter have a high quality of living.	1.5
Cities that are the hometown of at least 18 bands and the headquarter of at most one airline founded in 2000 have a high quality of living.	1.5
Cities where at least two CDs have been recorded and where no compact car is produced have a high quality of living.	1.44

Intra-class correlation coefficient: 0.8977