Investigating lecturers' perceptions of the performance of computer-based and paper pencils-based for assessing sports training program during covid-19

The lack of information regarding exercise program assessment tools during the COVID-19 pandemic was the main gap in this research. The purpose of this study was to investigate lecturers' perceptions of computer-based and paper pencil-based performance to assess sports training programs during the COVID-19 pandemic. In this study, a combination of quantitative and qualitative (mixed) is used as a method. Participants in this study were male and female lecturers from Jakarta State University (N=15) and Sriwijaya University (N=10). Quantitative instruments use questionnaires and qualitative instruments use in-depth interviews with participants. Quantitative data analysis use the IBM SPSS version 25.0 to find descriptive data, namely mean, standard deviation and percentage of responses from participation. Meanwhile, qualitative data analysis use qualitative thematic data. The results of the study based on quantitative data found that the majority of lecturers strongly agreed to use computer-based instead of paper pencil-based to assess sports training programs. Meanwhile, research results based on qualitative data show that most lecturers favour computer-based over paper pencil-based during the COVID-19 pandemic. Thus, computer-based has better performance and advantages than paper pencil-based when used in the pandemic era. This research provides benefits for the development of science assessment tools in the field of sports. © 2021 by authors, all rights reserved.


Introduction
During the COVID-19 pandemic, the use of technology in learning, training or sports activities is increasing rapidly [1]. The technology is used as a support so that these activities can be carried out optimally [2], [3]. The technology that is often used is a computer which one of its functions is to assess or evaluate products, applications or training programs created by students [4], [5]. However, the assessment and evaluation of exercise programs in the field of sports is still paper pencil-based and this assessment is claimed by several researchers to have significant effects and have a high level of accuracy for assessing a work [6]. But in the COVID-19 era paper pencil-based is difficult to implement, because paper and pencil-based allow spreading of the virus among students and lecturers massive. One way to overcome this problem is by using a computer-based [7].
Despite many benefits that have been found by previous studies on computer-based, some researchers confuse the benefit and performance of computer-based compare to paper pencil-based [8]. The next gap found that there was not difference significantly between performance paper pencil-based and computer-based on learning outcomes assessment [9]. Similar results are reported by Akdemir & Oguz [10], showing that there is no difference in performance between computer-based and paper pencil-based. With a gap in the previous study, this research offers further research about computer-based performance versus paper pencil-based in the context of sports, so that the research later will provide scientific insight about which assessment system is more effective in the COVID-19 era.
Despite a lot of research on computer-based [11], [12], [13], [14], [15]. However, no previous research that has reported about lecturers' perceptions on the performance of computer-based and paper pencil-based in the COVID-19 era. In addition, previous studies about computer-based were carried out in general education and there is still little literature on computer-based in the context of sports. This research offers a different research from previous research, namely using a mixed-method so that the results of the research can be obtained through quantitative and qualitative data.
The urgency of this research problem is the importance of computer-based and paper pencil-based facts as a tool for assessing and evaluating sports training programs during the current COVID-19 pandemic, so that the findings from this research analysis can provide information for lecturers, trainers, teachers and practitioners about advantages and disadvantages of computer-based and paper and pencil-based. This research is expected to be a solution to reveal about effective assessment tools to be used during the COVID-19 pandemic. This study aims to determine lecturers' perceptions of computer-based and paper and pencil-based performance to assess sport training programs during the COVID-19 pandemic.

Lecturer's Perception of Computer-Based and Paper Pencil-Based
Lecturers' perceptions of computer-based and paper pencil-based are very important to investigate, because later the results of this study will provide information about the good or bad performance of computer-based to assess an exercise program created by students.
Computer-based is an assessment system that is carried out by using technology assistance such as computers [16], [7], laptops connected to the internet network [17]. Computer-based function to assist lecturers in carrying out assessment activities on students learning outcomes without having to direct meeting a person in the campus area [18]. Computer-based is able to present attractive features, because it can be accompanied by multimedia, graphics, short video clips [19], or sound files. Computer-based can provide feedback and is equipped with scoring facilities that can be accessed by students online. The other superiority of computer-based is that it can assess students' learning outcomes in a relatively great quantities [20]. The results of previous research found that computer-based has the power to increase motivation in conducting evaluations for students [21]. Quantitively of superiority the computer-based then the popularity of computer based has continued to increase significantly and has been used at school to university level in several countries [17], [22], [12], [23].
While paper pencil-based is a traditional assessment using paper and pencil to provide an assessment of the exercise program made by students. Previous studies reported that the use of pencil-based paper could reduce costs, can avoid data entry errors [24].
Given the previous literature that shows the advantages of computer-based and paper pencil-based, it is important to examine more deeply about these two assessment tools.

Methods
The mixed-method (qualitative and quantitative), in this research is used as a methodological approach [14]. Some experts define mixed-methods as a methodology that combines qualitative and quantitative as a way to solve problems [25], [26]. According to Creswell [27], mixed-methods research is a study that combines quantitative and qualitative research. Thus, mixed research will produce facts that are more comprehensive in researching research problems.

Participation
Participants in this research came from two universities in different regions in Indonesia with details of male and female lecturers (N=15) from the State University of Jakarta. Then, male and female lecturers (N=10) from the University of Sriwijaya. The sampling technique used to determine the participants was purposive sampling by selecting lecturers who were experts in the assessment system. Before the research began, all participants in this research were asked to sign a letter regarding their willingness to sample in all activities. To protect the sample identity the authors gave code P. For more details, Investigating Lecturers' Perceptions of the Performance of Computer-Based and Paper Pencils-Based for Assessing Sports Training Program during COVID-19 the characteristics of the subject can be seen in Table 1. The value can be presented as mean ± standard deviation.

Instruments
To measure of lecturers perceptions about computer-based and paper pencil-based, can use a questionnaire as an instrument for quantitative research [28], as follows: Q1: I prefer to carry out the assessment using computer-based.
Q2: I prefer to carry out the assessment using paper pencil-based.
Q3: Computer-based is more effective in the COVID-19 era.
Q4: Paper pencil-based is easier to implement instead of computer-based.
Q5: Computer-based is more objective for assessment in learning outcomes.
The above questionnaire has been tested especially until it has a validity level of .98 and a reliability of .81. Testing the validity and reliability using IBM SPSS version 25.0. To complete the questionnaire above, it can be using a Likert scale from 1 (strongly disagree) to 5 (strongly agree).
Then, this research using in-depth interviews with respondents as a qualitative instrument [14]. The questions asked are: Question 1: What makes computer-based more superior to paper and pencil for assessing learning outcomes in the COVID-19 era? Question 2: Which assessment do you prefer between computer-based and paper pencil-based? Question 3: Which assessment is more objective?

Research Procedure
This research has received permission from the State University of Jakarta and the University of Sriwijaya with Circular 21/04/2021. In addition, this research has followed the Ethics guidelines from the World Medical Association (Helsinki Declaration). In the first phase of the research (e.g. the first week) all participants were instructed to fill out a questionnaire that had been provided on the computer online with a duration of 60 minutes. Then in the second phase of the research (e.g. a second week) all participants were instructed to complete a paper pencil-based questionnaire with a duration of 60 minutes. All participants were interviewed individually for 10-30 minutes. Interviews were conducted in the Indonesian language. In-depth interviews were carried out via whatapps telephone.

Data Collection Technique
Collecting data in this study is through two steps: first through filling out a questionnaire. A questionnaire is a technique for collecting data when carrying out quantitative research by giving written questions to participants. The questionnaire is a data collection technique that is efficient and effective in obtaining answers from relatively many participants. Second through interviews with the research participant. According to Creswell [27], interviewing is a technique for collecting data by conducting questions and answers between researchers and participants. Interviews can be conducted through face to face or can use technological media, such as Whatsapp, Webex, Zoom meetings, Google meet, Telegram. Interviews are an effective way to collect qualitative data.

Data Analysis Technique
Characteristic of data quantitative will be analyzed by using IBM SPSS application version 25, which functions to test the statistical descriptive (mean, standard deviation) and percentage. Meanwhile, the analysis processed after the research data qualitative from the interviews have been collected, including: (1) Interviews are transcribed word by word. (2) The transcribed interviews is read repeatedly by the author to get a broad understanding. (3) The texts are arranged based on a description of the experience and then each given label. (4) Data are sorted based on categorization, coding, and highlighting based on similarities. (5) A collection of similar phrases grouped and arranged into the initial theme. (6) Examining the meanings of the phenomenon being studied. (7) Arranging the data into themes with a description of each theme. (8). Share themes with parents to get a deeper understanding [29].

Theme 1: Excellence
Question 1: What makes computer-based more superior to paper pencil-based for assessing learning outcomes in the COVID-19 era?
Participants expressed their positive perceptions of computer-based compared to paper pencil-based [28]. For example, see some of the common quotation selected by participants as follows: "Computer-based is more excellent than paper pencil-based in the COVID-19 era, because of computer-based can be done anytime and anywhere, by preparing a computer, laptops or handphone that connected to an adequate internet network we can carry out an assessment on learning outcomes that students create (e.g., creating learning support programs or applications)" P1, P3, P5, P7, P10.
"Computer-based is a technology that is effectively used in the era of COVID-19 to assess student product results, because computer-based can provide feedback (e.g., provide scores, corrections or suggestions) directly to the work, ideas or products produced by students" P4, P6, P8, P9, P11, P12.
Another participant gave his opinion: "Computer-based provides immediate feedback with answers and explanations. In addition, students can find out about the advantages and disadvantages of the products they create" P2, P13, P14.
Some participants argue that: "Computer-based is more excellent than paper pencil-based, because it can assess or evaluate a relatively large number of products made by students. This means that computer-based has a better level of efficiency than paper pencil-based" P15, P16, P21, P24.
"Although paper pencil-based has several evaluation models (e.g., CIIP), the use of these models will not be very effective and optimal in the era of COVID-19 to evaluate a product." P17, P18, P19, P20, P22, P23.
"The difference in performance between computer-based and paper pencil-based can be seen from the time difference in completing an assessment of the work, product, or program created by students. Using computer-based we were able to complete the assessment in about 40-50 minutes while the paper and pencil took about 1 hour. Another advantage of computer-based is that it is very easy to access and has interesting features." P25.

Theme 2: Most Preferred Assessment
Question 2: Which assessment do you prefer between computer-based and paper pencil-based? About the assessment system the participants gave his opinion that: "We prefer to use computer-based in the current pandemic era, because computer-based makes it easy for us to assess and evaluate products created by students. Through computer-based we can provide scores, corrections and suggestions directly through the computer-based platform and students can find out." P1, P2, P4, P5, P7, P9, P10.
Some of the participants expressed the opinion: "We prefer computer-based, because the use of computer-based in pandemic conditions will be safer than paper pencil-based. In addition, lecturers can assess and evaluate student products in a relatively large number." P3, P8, P11, P13, P15, P16.
"We favor computer-based over paper pencil-based, because computer-based has the advantage of being able to conduct assessments anywhere, anytime and without any time limit. Simply by logging on to the computer-based platform, we can assess students' work." P6, P12, P14.
The other participants argued: "The use of paper pencil-based in the COVID-19 era will experience obstacles and be difficult to implement, because there are so many regulations issued by the Indonesian government, for example social or physical distancing or not being allowed to hold activities with 1008 Investigating Lecturers' Perceptions of the Performance of Computer-Based and Paper Pencils-Based for Assessing Sports Training Program during COVID-19 a large number of people. With this regulation, we think it will be difficult to implement paper pencil-based in current conditions," P17, P18, P19, P20, P21.
"We prefer to use computer-based, because computer-based is easy to access, attractive, more efficient and effective. In addition, with computer-based we can clearly see the works presented by students.

Theme 3: Objective
Question 3: Which assessment is more objective? Participants expressed the opinion that: "We think that computer-based is much more objective to conduct and provide an assessment of the products created by students. Computer-based can provide an assessment without face to face between lecturers and students, thereby minimizing the occurrence of subjective assessments." P1, P12, P3, P14, P5, P6, P7, P8, P9, P10, P11, P22, P20, P24, P25.
"Computer-based is more objective than paper pencil-based, because the assessment is carried out through a platform with different user names and passwords between lecturers and students, so that the results of the assessment cannot be known by others." P2, P13, P4, P15, P16, P17, P18, P19, P23, P21.

Discussions
The purpose of this study is to investigate lecturers' perceptions of computer-based and paper pencil-based performance to assess sport training programs during the COVID-19 pandemic. The quantitative research results show that there is a significant difference the performance of computer-based and paper pencil-based. The findings in this study are not in line with previous studies which reported that there was no significant difference between performance on computer-based and paper pencil-based [9]. In addition, the research conducted by Khoshsima & Toroujeni [14] also confirms that based on the results of show that there was not difference value by significant statistically between paper pencil-based and computer-based. The results are not in line between this study and previous research due to several factors, namely the first is the very different conditions of computer-based and paper pencil-based implementation, where in the previous study a study was conducted on the performance of computer-based and paper pencil-based under normal conditions in Indonesia, absence of the COVID-19 pandemic [30], whereas this study examines computer-based and paper pencil-based in pandemic conditions, so this factor is the answer to why there is a difference in performance between computer-based and paper pencil-based. Second, because of the different characteristics of computer-based and paper pencil-based, computer-based prioritizes the use of technology and internet assistance [31], [32], while paper pencil-based is more dominant in using pencil and paper assistance [33] as well as direct observation of the product to be assessed [34]. If you look at the current conditions, the computer-based assessment system is more profitable because it has many advantages, for example computer-based can be done anytime and anywhere [35]. In addition, it can provide direct assessments and evaluations in the form of notes or videos [36]. Then computer-based has a high level of accuracy and objectivity to assess a product [37]. In addition, according to Garas & Hassan [38], computer-based can increase efficiency and provide instantaneous feedback to students, which is more fun and not boring for students. In contrast to the paper pencil-based which is difficult to do in the current pandemic and tends to pose a big risk, for example, being unable to conduct an assessment with a relatively large number of students. Lecturers are not objective when giving assessments, because they are anxious and afraid of contracting COVID-19. Thus, these factors cause the difference in performance between computer-based and paper pencil-based.
Meanwhile, based on the qualitative results most of the participants thought that computer-based had special quality (e.g. it was easier to implement, could be assess learning outcomes with a large number of students, received feedback instantly, could know directly the exam score) [39], [28] compared to paper and pencil to assess students' learning outcomes in sport or assess sports training programs during the COVID-19 era. The results of this research were also supported by previous studies which reported that most participants showed preference of computer-based that a higher than paper and pencil and also more excellent of computer-based to compare of paper pencil-based [40]. The results of research conducted by Jeong [41], support the results of this study, the data reports that there is a significant difference between computer-based and paper pencil-based performance to assess Korean learning outcomes.

Conclusions
Based on the results of quantitative data, this research confirms that the majority of lecturers answered "strongly agree" to use computer-based to assess sports training programs during the pandemic. In addition, the qualitative data collected from the interview sessions shows that most of the lecturers chose and favored computer-based over paper pencil-based to assess and evaluate all the work of students in field sport during the COVID-19 era.
The implication of this research is to add to the literature on computer-based and paper pencil-based, so that later it can provide scientific insights to lecturers about the implementation of assessment and evaluation of sports traning program made by students during the COVID-19 era. Further research needs to be done, for example comparing the computer-based assessments system with other assessments such as google classroom versus zoom meeting.