CESORP User Study

Welcome to the CESORP study!

The purpose of this study is to examine the impact of different explanations on human prediction ability in different contexts.

This research project is conducted by Dr. Ulrike Kuhl at Bielefeld University. People of any gender, aged 18 and above, are invited to participate.

Your participation in this research study is voluntary. You may choose not to participate. If you decide to participate, you may withdraw at any time without giving any reason. In this case, all data collected will be deleted.

In this study, you will be introduced to a managment system that evaluates aspects of a person's past professional performance to make decisions about monetary bonuses. Your task will be to guess the system's decisions, aided by explanations for previous decisions.

Afterwards, you will be asked to answer a short questionnaire assessing your experience with the system. Participation will take approximately 10 minutes.

Your responses will be treated confidentially. No identifying information such as your name, email address or IP address will be recorded.

After completion of the study, the research data collected will be made publicly available in anonymized form that does not allow any conclusions about individual or specific persons. The purpose, type, and scope of potential subsequent use are currently not foreseeable.

If you have any questions about the research study, please contact Dr. Ulrike Kuhl at ukuhl@techfak.uni-bielefeld.de. The study was approved by the Ethics Committee of Bielefeld University, Germany.

ELECTRONIC CONSENT: Please select your choice below. I hereby agree that I

have read the participant information and that I understand it
agree to participate voluntarily in the study under the conditions described in the participant information
am at least 18 years of age

If you do not wish to participate in the research study, please decline participation by closing this window.

Continue

Instructions

Please read the following information carefully:

In the following experiment, you will see summaries of past performance like this:

Quality of work	High
Productivity	High
Punctuality	Low
Customer feedback	Low
Bonus?	??

Will get the bonus?

Yes

Your task is to review the information and guess the system's prediction.

After each guess, the system's prediction and an explanation will be shown to you.

Review this information carefully to improve your own guesses.

Continue

Please rate your agreement with the following statement as truthfully as possible.

From your interaction with the system, please weight the four aspects used by PERS according to their importance

{{featuresDesc[0]}}
Least Important Most important

{{featuresDesc[1]}}
Least Important Most important

{{featuresDesc[2]}}
Least Important Most important

{{featuresDesc[3]}}
Least Important Most important

Next rating

Debriefing

Thank you for participating in the CESORP (”Counterfactual Explanations in Self- vs. Other Relevant Predictions”) study! Your participation is invaluable to our research, and we appreciate the time and effort you have contributed.

Purpose of the Study
The aim of this study is to explore how well individuals can emulate predictions of AI systems that provide counterfactual explanations. We investigate how human decision-making ability and trust in AI-systems change when the prediction subject (i.e., the person or thing the prediction is about) is you versus someone else.

Why This Research is Important
Understanding how personal relevance affects interaction with AI systems is crucial for designing effective and user-friendly AI applications. By exploring these differences, we aim to improve the design of AI systems to ensure they can better meet user needs, whether the context is personal or impersonal. This knowledge can inform the development of AI applications in various domains, such as personalized healthcare, financial planning, and public policy, making these systems more intuitive, trustworthy, and effective.

Confidentiality and Use of Data
Please rest assured that all data collected during this study will be kept confidential and used solely for research purposes. Your responses will be anonymized and will not be linked to your identity.
If you would like your data to be deleted from our study, please contact the principal investigator. Use the following unique code to request the deletion of your data:
{{userId}}
This code helps us identify and remove your data while ensuring your privacy. Please note that without this code, we cannot delete the data.

Contact Information
If you have any questions or concerns about this study, or if you would like to learn more about the research outcomes, please feel free to contact us at:
Principal Investigator: Dr. Ulrike Kuhl, ukuhl@techfak.uni-bielefeld.de, Bielefeld University

Finish

Welcome to the CESORP study!

Instructions

Instructions

Instructions

Next, it is your turn and you have to guess the system's prediction.

Case {{curTrialID + 1}}/16

This concludes the first part of the study. Next, we would like to ask you to answer some questions.

Please rate your agreement with the following statement as truthfully as possible.

Please rate your agreement with the following statement as truthfully as possible.

Please answer the following questions as truthfully as possible.

Question {{curQuestionId + 1}}/{{questionnaireData.length}}

Debriefing

{{featuresDesc[feature.f_id]}}	{{feature.f_value}}
Bonus?