Paper-based versus digital-based learning among undergraduate medical, nursing and pharmaceutical students in Japan: a cross-sectional study

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • We assessed students’ format preferences for academic performance and eyestrain among medical, nursing and pharmaceutical students in the drastically transformed learning environment due to the COVID-19 pandemic.

  • Our study is based on students’ evaluations (perspectives) and not on empirical or objective data.

  • Other potential factors, such as the online skills of faculty members, socioeconomic status (affordability) and home environments, were not evaluated in our study.

Introduction

The emergence of COVID-19 in December 2019 has undoubtedly posed an enormous challenge to education systems worldwide, disrupting the conventional face-to-face classroom setting. According to the United Nations Educational, Scientific and Cultural Organization, over 100 countries provisionally closed their educational institutions nationwide to contain the spread of COVID-19.1 Following the state of emergency declaration, Japan’s Ministry of Education, Culture, Sports, Science and Technology announced the temporary closure of all primary and secondary schools from March to May 20202 and requested all universities to maintain social distancing among students in classes. Numerous educational institutions in Japan rapidly adopted online-based learning to address students’ learning needs and reduce the risk of infection. All university staff and faculty members started to deliver digital textbooks and recorded lectures to students via Zoom, Moodle and YouTube.3–5

Online education has been recognised and documented as a promising and effective mode for teaching undergraduate medical and nursing students.6–8 Ruiz et al discussed that e-learning technology gives students control over content, pace and ability to tailor materials to their interests.9 However, before the COVID-19 pandemic, format-related differences (ie, paper-based learning (PBL) or digital-based learning (DBL)) in learning outcomes had already been well studied. In terms of cognitive task performance, the evidence, though mixed,6 10 pointed towards screen inferiority.11–13 Several meta-analyses have also reported inferior results of screen-based learning.14 15 Many studies have attributed screen inferiority for text learning to technological disadvantages such as scrolling or eyestrain.12–16 Some studies argued that increasing exposure to technology, as it improves efficiency and allows multitasking, may promote shallower cognitive processing, decreasing deep comprehension in digital environments.17 18 Levine et al showed that the amount of time college students spent sending instant messages was significantly related to higher ratings of distractibility during academic task performance.18 As a result, students preferred reading on digital devices for non-academic tasks, such as during leisure time or when reading the news, while reading on paper for academic tasks.19–21

Although these issues related to DBL have been reported, they may change over the years because of the technological advancements in digital devices and human factors, that is, being born in a digital era. For young students who grow up surrounded by digital technologies, screen inferiority might not initially exist. During the COVID-19 pandemic, all undergraduate students in Japan were forced to adapt to DBL.22 Therefore, they experienced learning academic tasks using digital devices, which required in-depth cognitive processing. In this drastically transformed learning environment, an assessment should be conducted to determine whether screen inferiority in academic performance exists among undergraduate university students. In addition, assessing the impact of screen devices on ocular health is also important because there are serious concerns as the prevalence of myopia among Japanese high school students has steadily increased, reaching a record high of 70.81% in 2019.23

Thus, this study aimed to examine (1) the format preference for academic performance and eyestrain between DBL and PBL using descriptive data and (2) the associations of the format preference with students’ daily time spent using DBL among medical, nursing and pharmaceutical students in Japan during the COVID-19 pandemic. Our findings will help improve the understanding of the effects of DBL and provide effective educational settings for undergraduate students.

Materials and methods

Study design, participants and data collection

A cross-sectional study using a self-administered online questionnaire (Google Forms) was conducted at the University of Toyama, Japan. This university began providing online courses in February 2020, owing to the COVID-19 pandemic. All students were forced to adapt to DBL for more than 1 year to earn enough credits for the next grade. In April and May 2022, as part of social medicine practice, we and the undergraduate medical students attending our laboratory distributed an e-mail invitation containing a Google Form link to 939 undergraduate medical, pharmaceutical and nursing students in preclinical grade (first–fourth-year medical and pharmaceutical students and first–third-year nursing students). Students who read the explanation about the study and consented to participate answered the online questionnaire.

Measures

The questionnaire contained questions evaluating the participants’ general demographics such as age, sex, study major (course), daily time spent using DBL at home on a weekday and format preference for academic performance and eyestrain between PBL and DBL. The definition of DBL was reading digital formats such as PDFs or viewing videos. The questionnaire items were rated on a 5-point Likert Scale: 1=strongly choose paper, 2=choose paper, 3=both are equivalent, 4=choose digital and 5=strongly choose digital. Age was assessed by category (18–20 years, 21–23 years and ≥24 years) to maintain the anonymity of the students. Based on the results of previous studies, academic performance included reading comprehension, memory retention and absorption (concentration) in learning.12 20 24 We added a question regarding ocular health. The following questions were used:

Q1: Which between PBL and DBL of an academic text provides a more comprehensive understanding?

Q2: Which between PBL and DBL can significantly improve your memory when studying an academic subject?

Q3: Which between PBL and DBL can significantly improve your absorption (concentration) when studying an academic subject?

Q4: Which between PBL and DBL can strongly cause eyestrain when studying an academic subject?

The answers were then arranged into three categories: paper, equivalent and digital. Evaluating digital devices better for academic performance and eyestrain was defined as ‘digital preference.’

Statistical analysis

Data were collected in Microsoft Excel, and statistical analyses were performed using IBM SPSS Statistics for Windows, V.25.0 (IBM, Armonk, New York, USA).

Descriptive analyses were performed to present the students’ characteristics and their format preference for academic performance and eyestrain between PBL and DBL. The χ2 test was used to determine significant differences by sex and student major (figures 1–3, online supplemental figure 1). To explore the association between students’ daily time spent using DBL and their digital preference for academic performance and eyestrain, the Cochran-Armitage trend test and multivariable (age-adjusted and sex-adjusted) logistic regression analysis were performed. A p value<0.05 was considered statistically significant.

Supplemental material

Figure 1
Figure 1

Which is better for ‘comprehension’, paper or digital formats? Evaluations were evenly distributed among the response options: paper (32.0%), equivalent (32.8%) and digital (35.2%). Medical students were more likely to prefer digital-based learning compared with nursing and pharmaceutical students (χ2 test).

Figure 2
Figure 2

Which is better for ‘memory retention?’ Approximately 71.2% of the students reported that paper-based learning (PBL) was better, and only 6.1% preferred digital-based learning. A high proportion of women preferred PBL (χ2 test).

Figure 3
Figure 3

Which is better for ‘absorption (concentration)?’ Approximately 74.7% of the students evaluated paper-based learning (PBL) better, and only 6.7% preferred digital-based learning. More women preferred PBL (χ2 test).

Patient and public involvement

Patients and the public were not involved in the design of the study, the conduct of the study, or the dissemination of the findings.

Results

A total of 344 (191 medical, 73 nursing and 80 pharmaceutical) university students responded to the survey (response rate: 36.6%). Women accounted for 46.8%, 97.2% and 56.3% of the medical, nursing and pharmaceutical students, respectively. Most of the students were aged 18–23 years, suggesting that they were born around 2000 (table 1). With regard to the daily time spent using DBL on a weekday, more than half of the students spent less than 2 hours.

Table 1

Characteristics of participants

Figure 1 shows the percentage of students’ preferences in the comprehension domain between PBL and DBL. Their preferences were evenly distributed among the response options: PBL (32.0%), equivalent (32.8%) and DBL (35.2%; digital preference). Medical students were more likely to prefer DBL compared with nursing and pharmaceutical students. Figure 2 shows the distribution of the memory retention domain. Approximately 71.2% of the students reported that PBL was better, and digital preference was only 6.1%. A high proportion of women preferred PBL. Figure 3 shows the distribution for the absorption (concentration) domain. Similar to the memory retention, 74.7% of the students evaluated PBL better, and digital preference was only 6.7%. More women preferred PBL than did men. Online supplemental figure 1 shows the distribution of eyestrain rates. Most students (84.6%) reported more eyestrain during DBL; digital preference regarding eyestrain was observed in only four students (1.2%).

Table 2 shows the percentages of digital preference for academic performance and eyestrain and their association with students’ daily time spent using DBL. Regarding comprehension, a significant positive trend (p=0.006) and association were observed in the Cochran-Armitage trend test and multivariable logistic regression analysis (OR=1.94, 95% CI 1.12 to 3.37 for ‘≥4 hours’). However, no positive trend or association was observed for memory retention, absorption and eyestrain. Confounding factors (age and sex) were not significantly associated with digital preference in all models.

Table 2

Association of digital preference with daily time of DBL (N=344)

Discussion

We examined the format preference for academic performance and eyestrain between DBL and PBL among undergraduate medical, nursing and pharmaceutical students during the COVID-19 pandemic. These students were born in the digital era. We demonstrated that PBL was better than DBL regarding memory retention and absorption for most students, and the majority of students responded that they experienced more eyestrain during DBL. Moreover, although our study showed a positive association between daily time spent using DBL and students’ digital preference only in the comprehension domain, the association was not seen in memory retention, absorption and eyestrain. This means that even those students who used DBL for a long duration did not evaluate DBL favourably (table 2). To the best of our knowledge, this study is the first to demonstrate an association between the duration of DBL use and the digital preference for academic performance among university students during the COVID-19 pandemic.

In psychology, there are three memory processes: encoding information (learning it by perceiving it and relating it to previous knowledge), storing it (maintaining it over time, memory retention) and then retrieving it (accessing the information when needed).25 Comprehension in our study corresponded to the encoding information phase, and students’ preferences for it were evenly distributed among PBL, equivalent and DBL (figure 1). Compared with the memory retention and absorption results, not a small number (one-third) of students reported that DBL was better. This may be attributed to digital textbooks offering a wide range of text and graphical information, containing hyperlinks to specific content and allowing individualised learning. For example, manipulating a three-dimensional figure in digital text in an anatomy class may help students understand the complex structure of the human body. In addition, students who used DBL for a longer duration significantly evaluated it better (table 2). A plausible explanation is that students became proficient at using useful functions such as writing and underlining on PDFs or browsing text swiftly, leading to better understanding. However, caution is warranted when interpreting the results of students’ evaluation of digital learning. Several studies have reported greater overconfidence, meaning a wider difference between the predictive and actual academic performance scores in DBL than in PBL.14 15 Overconfidence was considered to be caused by mind wandering, distraction and poorer judgement, which frequently occurs in DBL owing to less focus in reading the text.12 26

Memory retention, the second memory process25 and absorption (ie, concentration) are crucial components of the learning process. Without absorption, deeply memorising complex and time-consuming information is impossible. In our study, contrary to our estimation in this digitally transformed society, most students preferred PBL for memory retention and absorption (figures 2–3). This finding aligned with previous studies showing the phenomenon of ‘screen inferiority’.11–14 27 In a previous study of 10 293 tertiary students worldwide, Mizurachi et al reported that 72.3% agreed that information retention was more enhanced when reading printed pages.24 Several plausible factors may explain the superiority of PBL over DBL. The paper’s constant (unchanged) tactile substrate with physical sizes and spatial locations can serve as a deepening memory cue, and note-taking on paper may enable students to unconsciously summarise and reframe information in their own words.13 28 Another explanation is that digital media such as e-mail or online communication may only stimulate superficial reading strategies, including scanning, skimming and browsing, at the expense of a more time-consuming process that allows for deeper comprehension.19 29 Umejima et al performed a biophysical study using functional magnetic resonance imaging among university students in Japan. They observed brain activation in the hippocampus and precuneus, which are related to memory function during the deeper encoding and retrieval of specific information. They found that the activation in these areas was stronger in groups using a paper notebook than in those using digital devices,30 indicating that using paper notebooks promotes active brain function. Digital devices can also encode information equally to paper; however, it is inferior to paper in storing information.

Eyestrain is one of the symptoms of computer vision syndrome, along with other symptoms such as irritation, burning sensation, dry eyes and blurred vision.31 32 These symptoms occur more frequently with longer use of visual displays, viewing from a closer distance to the screen and glaring background luminance.32 33 A previous study reported that the symptoms of eye discomfort following computer use were significantly worse than those after hard-copy viewing.34 Consistently, the majority of students (84.6%, in online supplemental figure 1) experienced more eyestrain during DBL. These results can renew our knowledge: digital-native students born or raised in the digital technology age were as susceptible to eyestrain during DBL as the older generation. Government reports showed a drastic increase in internet use in Japan after the COVID-19 pandemic. The average time of internet use on a weekday among people in their 20s was 177 min in 2019 and it increased to 275 min in 2021.35 Therefore, our study emphasised the significance of raising public awareness about the possible occurrence of eyestrain caused by the use of digital devices among younger generations.

Our study reported no association between daily time spent using DBL at home and their digital preference for memory retention, absorption and eyestrain (table 2). Students who were used to DBL were expected to be more accepting of DBL; however, the results of students’ preferences seemed to contradict this expectation. Our data demonstrated that although students experienced screen inferiority in academic performance and eyestrain, they studied digitally because most academic texts provided by the university were only available digitally. To the best of our knowledge, no other study has assessed the association between students’ daily time spent using DBL and their preference after the drastic transformation of the learning environment due to the COVID-19 pandemic. Our findings show the possibility that students’ academic performance will not increase in highly digitalised study environments. Therefore, further prospective studies are needed to clarify the association between DBL and academic performance among students in the future.

Among the characteristics, different trends were observed in sex and students’ majors: medical, nursing and pharmaceutical courses. In our study, women were more likely to prefer PBL than men (figures 2 and 3). This finding aligned with previous studies,3 4 showing that more women were dissatisfied with online-based education. Although the difference was small in the students’ majors, medical students preferred DBL for academic performance compared with other students (figures 1–3). This may be because medical students need to earn more credits (subjects) and carry heavier and more printed textbooks every day. Therefore, more medical students may prefer digital text for easy accessibility and portability.12 24

Our study has some limitations. First, it is based on students’ evaluations (preference), not empirical or objective data. However, in a study using a computer-based achievement test conducted among medical students in Japan, those who preferred face-to-face classes had significantly higher scores than those who preferred online classes.3 Meta-analyses of empirical studies also reported inferior results with on-screen learning.14 15 Therefore, our subjective study is not largely different from studies using objective data. Second, this study was only conducted among medical, nursing and pharmaceutical students in one university; therefore, our results cannot be fully generalised to other university students. However, our study was conducted when all students were forced to adapt to DBL in Japan because of the COVID-19 pandemic. Therefore, our findings seem more generalisable than previous reports, 14,15 which were conducted before the COVID-19 pandemic. Third, the response rate was less than 40%. Thus, our data might be subject to selection bias. However, we considered that students who preferred digital devices were more likely to answer our online questionnaires. Therefore, PBL preference rate may be higher among the general university student population than in our study. Finally, our study did not evaluate other potential factors, such as the online teaching skills of faculty members, socioeconomic status (affordability) and home environments. All faculty members prepared digital textbooks and videos in the chaotic situation of the COVID-19 pandemic36; thus, improvised online textbooks might not have been well organised compared with print textbooks. In the future, these potential factors should be included in studies to explore the factors influencing students’ academic performance.

Conclusion

Among medical, nursing and pharmaceutical students, we examined the format preference for academic performance and eyestrain between DBL and PBL in drastically changing learning environments in Japan. Most students reported that PBL was better than DBL in terms of memory retention and absorption, and even those who had used DBL for a long duration did not evaluate it well. These results have several important pedagogical implications. Faculty members should not assume that digital transformation in higher education settings has a desirable impact on academic performance. Although technology has been developed, it may be better to regard digital devices as a supplement for PBL rather than a replacement. A learning environment where students can study on paper textbooks should be continued.

Data availability statement

Data are available upon reasonable request. Our data are not publicly available due to the institutional restrictions of the University of Toyama. But on reasonable request, relevant datasets are available from the corresponding author.

Ethics statements

Patient consent for publication

Ethics approval

This study involves human participants and was approved by the Ethics Committee of the University of Toyama, R2023082. Participants gave informed consent to participate in the study before taking part.

Acknowledgments

We would like to thank all of the undergraduate students for participating in the online survey and thank Yuuna Higuchi Jun Ichikawa and Mayu Somekawa for inviting other students to participate in this survey. We also thank Editage (https://www.editage.com/) for proofreading this manuscript for English language.

This post was originally published on https://bmjopen.bmj.com