Educação e Tecnologia

Scientific production of flipped learning and flipped classroom in Web of Science

Produção científica de aprendizagem invertida e sala de aula invertida em Web of Science

Jesús López-Belmonte
Universidad de Granada, España
Antonio-José Moreno-Guerrero
Universidad de Granada, España
Juan-Antonio López-Núñez
Universidad de Granada, España
Santiago Pozo-Sánchez
Universidad de Granada, España

Scientific production of flipped learning and flipped classroom in Web of Science

Texto Livre: Linguagem e Tecnologia, vol. 14, núm. 1, e26266, 2021

Universidade Federal de Minas Gerais

O autor de submissão à revista Texto Livre cede os direitos autorais à editora da revista (Faculdade de Letras da UFMG), caso a submissão seja aceita para publicação. A responsabilidade do conteúdo dos artigos é exclusiva dos autores. É proibida a submissão integral ou parcial do texto já publicado na revista a qualquer outro periódico.

Recepción: 15 Noviembre 2020

Aprobación: 07 Enero 2021

Publicación: 12 Marzo 2021

Abstract: This study focuses on knowing the scientific production of the terms flipped learning and flipped classroom in specialized literature, determining their conceptual evolution, the most relevant topics and the most prolific authors. A bibliometric study has been carried out supported by a structural and dynamic analysis of co-words. Both terms have been analyzed in the Web of Science, reporting 2968 documents and observing a much higher production in the flipped classroom. Despite the fact that both terminologies are frequently used as synonyms, in the scientific community they are differentiated, observing different trends and fields of study according to the concept. The results may promote the search for a terminological consensus that clearly delimits the area covered by each concept.

Keywords: Bibliometric study, Flipped learning, Flipped classroom, Analysis of co-words, Web of Science database.

Resumo: O objetivo deste estudo é conhecer a produção científica dos termos flipped learning e flipped classroom na literatura especializada, determinando sua evolução conceitual, os temas mais relevantes e os autores mais prolíficos. Foi realizado um estudo bibliométrico apoiado por uma análise estrutural e dinâmica de co-palavras. Ambos os termos foram analisados na Web of Science, relatando 2.968 documentos e observando uma produção muito maior na sala de aula invertida. Apesar de ambas as terminologias serem frequentemente utilizadas como sinônimos, na comunidade científica elas se diferenciam, observando diferentes tendências e campos de estudo de acordo com o conceito. Os resultados podem promover a busca por um consenso terminológico que delimite claramente a área de abrangência de cada conceito.

Palavras-chave: Estudo bibliométrico, Aprendizagem invertida, Sala de aula invertida, Análise de co-palavras, Banco de dados da Web of Science.

Resumen: El objetivo de este estudio es conocer la producción científica de los términos aprendizaje invertido y aula invertida en la literatura especializada, determinando su evolución conceptual, los temas más relevantes y los autores más prolíficos. Se realizó un estudio bibliométrico apoyado en un análisis estructural y dinámico de co-palabras. Ambos términos fueron analizados en la Web of Science, reportando 2.968 documentos y observando una producción mucho mayor en el aula invertida. Aunque ambas terminologías se utilizan a menudo indistintamente, en la comunidad científica se diferencian, observando diferentes tendencias y campos de estudio según el concepto. Los resultados pueden promover la búsqueda de un consenso terminológico que delimite claramente el alcance de cada concepto.

Palabras clave: Estudio bibliométrico, Aprendizaje invertido, Aula invertida, Análisis de co-palavras, Base de datos de Web of Science.

1 Introduction

The present work deals with the state of the question in the scientific literature of one of the didactic approaches that are booming in the field of education: the emerging methodology known as flipped learning or flipped classroom (CABI, 2018; CHEN; HUANG y HWANG, 2019; ZAINUDDIN y col., 2019). Due to its dual denomination, this study emerges to explore in the different scientific works about the state, development, as well as the similarities and differences between both terms. The relevance of this research is based on the novelty of this study in the impact literature. With the completion of this literary analysis, the gap between the conceptual level and the generation of new knowledge about the state of the matter have been closed since no work has been reported to date to achieve the aforementioned purposes.

This innovative learning model has been implemented in the field of education for almost a decade. Its origin dates back to 2011, when its predecessors –Jonathan Bergmann and Aaron Sams– carried out a teaching praxis through audiovisual materials hosted on the Internet, so that students with regular attendance problems could view it and –consequently– follow the same learning rhythm as the rest of peers (BERGMANN y SAMS, 2012).

At present, education is positioned as one of the most promising approaches in the technopedagogical field (HINOJO LUCENA y col., 2019), due to the potentialities it is offering in the action of teaching and learning (HE y col., 2016), where in addition to relying on the use of ICT, it promotes project-based teaching and problem solving, thus making the learning process attractive (KOSTARIS y col., 2017).

This approach is pedagogically based on a mixed formative practice in which the digital plane is combined with the face-to-face (LEE; LIM y KIM, 2017), the technological with practicality (FROEHLICH, 2018). The instructive act begins outside the traditional learning environment (BORAO MORENO y PALAU MARTÍN, 2016), that is, in any space where the learner visualizes the audiovisual contents provided by the teaching staff, which will later be dealt with in the classroom in greater depth (EL MIEDANY, 2019; LONG; CUMMINS y WAUGH, 2017). All this gives the model a high component of ubiquity and flexibility, while the students can access the materials from any place and as many times as required, adapting to the needs and concerns (BLAU y SHAMIR-INBAL, 2017; BOELENS; VOET y DE WEVER, 2018; PEREIRA; FILLOL y MOURA, 2019). However, this innovative approach requires the involvement and commitment of learners to achieve good results in its application (TOURÓN y SANTIAGO, 2015), as well as the availability of mobile technology, digital content and the willingness of learners, aspects which are considered fundamental to generate an ecology of effective learning (HINOJO-LUCENA y col., 2018). In addition, it is also necessary to have a propitious physical environment where to visualize the contents, as well as a level of digital skills on the part of the teaching staff (LÓPEZ-BELMONTE; POZO SÁNCHEZ y col., 2019).

This emerging model makes better use of the classroom, since the time allocated to content delivery has been reduced thanks to the virtual complement produced in the learning phase (BAUER-RAMAZANI y col., 2016). This results in an exchange of roles between the agents involved, with the student assuming an active and practical profile in the face-to-face session (AHMED, 2016; MORTENSEN y NICHOLSON, 2015), where they interact with other learners, encouraging collaborative work (MACLEOD y col., 2018), as well as with the contents, with the teacher, and with the problems raised during daily practice (CASTELLANOS SÁNCHEZ; SÁNCHEZ ROMERO y CALDERERO HERNÁNDEZ, 2017; HWANG; LAI y WANG, 2015), evoking the student to the deployment of a higher order thought (UNIVERSITY OF OTAGO WELLINGTON, NEW ZEALAND y col., 2017). In this sense, the physical classroom is transformed into a dynamic and creative space (NOURI, 2016), where assimilated knowledge converges and is put into practice in a virtual way (ABEYSEKERA y DAWSON, 2015).

An important aspect to highlight is that explanations are never abandoned in the classroom. In order to achieve its effectiveness, it is recommended that the first minutes of the face-to-face session should be used to clarify any doubts that may have arisen in the students during the visualization of the audiovisual contents (MOK, 2014). On the benefits of their practice reported in the students, the literature reveals an increase in their motivation (SHIH y TSAI, 2016; TSE; CHOI y TANG, 2019), even higher than that originated by other technopedagogical approaches (THAI; DE WEVER y VALCKE, 2017). At the same time, it is encouraged the self-regulation and protagonism of the learners (MIÑO-PUIGCERCÓS; DOMINGO-COSCOLLOLA y SANCHO-GIL, 2018), autonomy (LLANOS GARCIA y BRAVO-AGAPITO, 2019), participation (CHYR y col., 2017), commitment (BRAVO; ALARCIA y GARCÍA, 2019; YILMAZ, 2017), responsibility (HUANG; HEW y LO, 2019), positive attitude towards learning (LEE; PARK y DAVIS, 2018; MCNALLY y col., 2017), collaborative work (BÁEZ PÉREZ y CLUNIE BEAUFOND, 2019;KWON y WOO, 2018; WU; HSIEH y YANG, 2017), problem-solving capacity (BOGNAR; SABLIĆ y ŠKUGOR, 2019; DELOZIER y RHODES, 2017) and class attendance (BLAIR; MAHARAJ y PRIMUS, 2016; MINGORANCE ESTRADA y col., 2017).

All these indicators result in improved performance (SOLA MARTÍNEZ y col., 2019) and, consequently, in the results obtained (FISHER y col., 2017; SACRISTÁN SAN CRISTÓBAL y col., 2017), in the scope of the learning purposes (AWIDI y PAYNTER, 2019; KAZANIDIS y col., 2019) and in the overall productivity of the training action (YOSHIDA, 2016), a situation that favours the students’ satisfaction by making them feel useful and productive (ROMERO; BUZÓN-GARCÍA y TOURON, 2019).

2 Material and methods

2.1 Research objectives and design

Given the transcendence of this emerging methodology in the impact literature –justified in the potentialities reported by its application– the interest of this research focuses on the analysis of scientific production on the two terms used (flipped learning and flipped classroom) that allude to such an innovative approach to teaching-learning. Therefore, the general objectives are established:

For this purpose, a bibliometric cutting methodology has been followed, based on a series of procedures for estimating, quantifying and evaluating scientific production (MARTÍNEZ y col., 2015). Analytical tracking and documentary measurement techniques have been used by means of indicators (variables) of literary production (cuadro 1), based on the PRISMA-P matrix protocols. Likewise, both the study topics and their evolution have been detected through scientific mapping (LÓPEZ-ROBLES y col., 2019; LÓPEZ-BELMONTE; MORENO-GUERRERO y col., 2019b).

Cuadro 1
Production indicators and inclusion criteria.
IndicatorsCriteria
Year of publicationAll documents are contemplated
LanguageAll languages are contemplated
Publication areax ≥ 15
Type of documentsAll documents are contemplated
Organisationsx ≥ 8
Sources of originx ≥ 19
Authorsx ≥ 6
Countriesx ≥ 18
Number of citationsThe five most cited documents
Fuente: own elaboration.

2.2 Procedure, data cleansing and analysis

The database used as a reference for the analysis was Web of Science (WoS), covering all its main collection:

With respect to the search process, the key words that would be used to report bibliometric information were first specified. For this purpose, the consultation was carried out in different thesauri (ERIC and UNESCO), which did not register any standardized concept that agglutinates the methodology in question, so it was decided to use flipped learning (FLLE) and flipped classroom (FLCL), as they are called in the impact studies. These concepts were then introduced into the WoS database independently and covering all existing scientific production to perform the search process in metadata alluding to the title, abstract and keywords. The tracking phase began in April 2019 and ended in December 2019. The unit of analysis reported was 3314 documents (FLLE=526; FLCL=2788), meeting the inclusion requirements of cuadro 1.

The structural and dynamic study of both terms has been carried out through a co-words analysis (HIRSCH, 2005), taking as references –among others– the index-h (COBO y col., 2011). Thus, a science map was designed and performance was analyzed with the purpose of locating and delimiting the subdomains of such concepts in the field of research, as well as their evolution.

To analyze the performance the tools have been used WoS’ Analyze Results and Creation Citation Report. These programs provide different bibliometric indicators that facilitate the analysis of reported documents. SciMAT software has been used for structural and dynamic development, as a specialized program to conduct a longitudinal co-word study. For this purpose, the following processes have been deployed:

Cuadro 2
Performance analysis.
ConfigurationValues
Analysis unitKeywords authorKeywords WoS
Frequency thresholdFLCLPe1 (2), Pe2 (2), Pe3(3),Pe4 (5), Pe5(5), Pe6 (5), Pe7 (2
Authors FLCL3
FLLEPe1 (2), Pe2 (2), Pe3(2), Pe4 (2), Pe5 (2)
Authors FLLE2
Type of networkCo-occurrence
Threshold union valueco-occurrenceFLCLPe1 (1), Pe2 (1), Pe3(2), Pe4 (2), Pe5 (2), Pe6(2), Pe7 (2)
Authors FLCL2
FLLEPe1 (1), Pe2 (1), Pe3(1), Pe4 (1), Pe5 (1)
Authors FLLE1
Standardisation measureEquivalence index
Clustering AlgorithmMaximum size: 9; Minimum size: 3
Evolutionary measureJaccard Index
Superimposed measureInclusion index
Fuente: own elaboration.

Fuente: own elaboration.

3 Results

3.1 Performance and scientific production

A total of 3177 documents (FLLE=84.36%; FLCL=15.64%) composed of various types of scientific texts have been analysed, from 2011, when scientific production begins, to the present (cuadro 3).

Cuadro 3
Diachronic analysis of all scientific production.
YearFLLEFLCL
201999399498
2018111527638
2017117657774
201694494588
201555395450
201417147164
201335154
20121910
2011-11
Total49726803177
Fuente: own elaboration.

The greatest scientific production is observed, both for FLLE and FLCL, in the year 2017, being from its beginnings until such date a constant development. On the other hand, it is from the following year when production begins to decline (figura 1).

Evolution of scientific production.
Figura 1
Evolution of scientific production.
Fuente: own elaboration.

The predominant language used by researchers in this branch of knowledge is English, both in FLLE and FLCL studies, considerably distanced from the next most widely used language, Spanish (cuadro 4).

Cuadro 4
Scientific language used.
LanguageFLLEFLCL
English46725252992
Spanish2084104
Chinese14142
Portuguese41115
Russian167
German-44
Korean213
Italian112
French-22
Turkish-22
Bulgarian112
Catalan-11
Hungarian-11
Fuente: own elaboration.

The area of knowledge of reference in the studies developed in both terms is that alluding to ”Education Educational Research”, concentrating there the greatest amount of production. In spite of this, there is a considerable variety of areas that deal with the subject to a lesser extent (cuadro 5).

Cuadro 5
Areas of knowledge.
Publication areaFLLEFLCL
Education Educational Research40218592261
Computer Science59404463
Engineering51293344
Social Science other topics11285296
Business Economics9188197
Linguistics227193
Chemistry117283
Arts Humanites other topics26668
Nursing125163
Health Care Science Services24850
General Internal Medicine34245
Psychology53742
Pharmacology Pharmacy-3939
Science Technology Other Topics92534
Communication52328
Information Science Library Science22527
Biochemistry Molecular Biology-2626
Literature-2424
Cell biology-2424
Telecommunications22224
Dentristry Oral Surgery Medicine-2121
Art-1515
Fuente: own elaboration.

The type of publication used primarily to reveal research findings is congress communications, closely followed by articles. The other publications are poorly represented (cuadro 6).

Cuadro 6
Type of document.
TypeFLLEFLCL
Communications21013391549
Papers23510511286
Abstracts6105111
Book Chapters236386
Editorial material44549
Revisions84452
Letters21517
Early access549
Newsitem-66
Book reviews336
Corrections123
Books-22
Reissues-11
Fuente: own elaboration.

The reference institution for the FLCL is the University of North Carolina, while for FLLE it is the National Taiwan University of Science Technology. The rest of the institutions have a medium or low incidence in scientific production (cuadro 7).

Cuadro 7
Institutions.
DenominationFLLEFLCL
University of North Carolina44852
University of Carolina Systems-3131
University of Hong Kong112030
Harvard University12930
State University System of Florida12829
National Taiwan University of Science Technology141327
University of North Carolina Chapel Hill12526
Pennsylvania Common Wealth System of Higher Education12526
University System of Georgia-2222
Universidad Politécnica de Madrid22022
Universitat Politécnica de Valencia51722
National Taiwan Normal University51520
University of Sydney61420
Universidad de Zaragoza61521
California State University System21618
Bohai University-1717
University of Michigan System-1717
Monash University11617
Universidad de Extremadura21517
Polytechnic Institute of Porto31417
State University of New York Suny System-1616
University of Michigan-1616
Ohio State University-1515
Va Boston Healthcare System11314
Northeast Normal University China-1313
MEF Universitesi819
Fuente: own elaboration.

The main author in FLLE is Hwang, G.J., while in FLCL there are several authors with a high output, such as Keengwe, J., Oigara, J.N. and Onchwari, G (cuadro 8). It also reflects the presence of authors who develop works using both terms.

Cuadro 8
Most prolific authors.
AuthorsFLLEFLCL
Hwang, G.J.191029
Keengwe, J.-1818
Oigara, J.N.-1717
Onchwari, G.-1717
Zainuddin, Z.4913
Jeong, J.S.11112
McLaughlin, J.E.11112
Scheg, A.G.3912
Liu, Y.-1111
Canada-Canada, F.1910
González-Gómez, D.1910
Wang, L.1910
Hew, K.F.4610
Lo, C.K.4610
Chen, N.S.279
Artal-Sevil, J.S.369
Hung, H.T.369
Li, Y.-88
Fuente: own elaboration.

Regarding the source of publication (cuadro 9), the collection ”Advances in Social Science Education and Humanities Research”, is the one that most publishes on FLCL, while on the FLLE concept is the collection ”INTED Proceedings”.

Cuadro 9
Most prolific authors.
DenominationFLLEFLCL
Advances in Social Science Education and Humanities Research5174179
INTED Proceedings47101148
EDULEARN Proceedings40104144
ICERI Proceedings237295
12TH International Technology Education andDevelopment Conference INTED173249
ACSR Advances in computer Science Research-4646
Destech Transactions on Social Science Education and Human Science24143
Frontiers in Education Conference34043
EDULEARN 8TH International Conference on Educationand New Learning Technology132942
INTED 2017 11TH International technology education andDevelopment Conference142741
Lecture Notes in Managements Science33639
10TH International Conference of Education Research andInnovation102333
Educational Technology Society72330
Computers Education72229
INTED 2016 10th International Technology Education andDevelopment Conference92029
Abstracts of Papers of the American Chemical Society22628
Journal Of Chemical Education22628
EDULEARN 15 7TH International Conference on Education andNew Learning Technologies42226
American Journal of Pharmaceutical Education-2525
Lecture Notes in Computer Science32023
Advances in intelligent systems research12122
Faseb journal-2121
International Journal of Emerging Technologies in Learning12021
Advancesin Education Research-1919
Fuente: own elaboration.

The country of reference in the scientific production on both concepts is the United States, although China follows closely, especially in the production concerning FLCL (cuadro 10).

Cuadro 10
Relationship of countries with production on the theme.
CountryFLLEFLCL
United States89741830
China32682714
Spain48196244
Taiwan51115166
Australia2598123
England237295
Turkey274269
Canada85664
Malaysia144256
South Korea332255
Germany45054
Japan172744
Italy132841
Indonesia82735
Norway52934
Russia62834
Brazil22931
Portugal72532
South Africa22224
India32023
Singapore41923
Thailand51722
Netherlands31720
Sweden-1818
Fuente: own elaboration.

The most outstanding references, both in FLLE (cuadro 11) and in FLCL (cuadro 12), show significant differences in relation to the importance and incidence in the scientific community itself, resulting in a higher citation index in the studies covered by the term FLCL.

Cuadro 11
FLLE most-cited articles.
ReferencesCitations
CHEN, Y.L., WANG, Y.P., KINSHUK, & CHEN, N.S. (2014). Is FLIP enough? Or should we use the FLIPPED model instead?. Computers & Education, 79, 16–27.165
TRAVIS, R. (2014). Student perceptions toward flipped learning: New methods to increase interaction and active learning in economics. International review of Economics Education, 17, 74–84.119
LAI, C.L., & HWANG, G.J. (2016). A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course. Computers & Education, 100, 126–140.104
HWANG, G.J., LAI, C.L., & WANG, S.Y. (2015). Seamless flipped learning: a mobile technology-enhanced flipped classroom with effective learning strategies. Journal of computers in education, 2(4), 449–473.96
SEERY, M.K. (2015). Flipped learning in higher education chemistry: emerging trends and potential directions. Chemistry education research and practice, 16(4), 758–768.72
Fuente: own elaboration.

Cuadro 12
FLCL: most-cited articles.
ReferencesCitations
O´FLAHERTY, J., & PHILLIPS, C. (2015). The use of flipped classrooms in higher education: A scoping review. Internet and Higher education, 25, 85–95. doi: 10.1016/j.iheduc.2015.02.002413
MCLAUGHLIN, JE, ROTH, MT, GLATT, DM, GHARKHOLONARECHE, N., DAVIDSON, C.A., GRIFFIN, L.M., ESSERMAN, D.A., & MUMPER, R.J. (2014). The flipped classroom: a course redesign to Foster learning and engagement in a health professions school. Academic Medicine, 89(2), 236–243.375
ABEYSEKERA, L., & DAWSON, P. (2015). Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research. Higher Education Research & Development, 34(1), 1–14.310
MASON, G.S., SHUMAN, T.R., & KATHLEEN, E. (2013). Comparing the effectiveness of an inverted classroom to a traditional classroom in an upper-division engineering course. IEEE Transactions on Education, 56(4), 430–435.293
DAVIES, R.S., DEAN, D.L., & BALL, N. (2013). Flipping the classroom and instructional technology integration in a college-level information systems spreadsheet course. Etr&D-Educational Technology research development, 61(4), 563–580258
Fuente: own elaboration.

3.2 Structural and thematic development

With respect to the continuity produced in the keywords in the delimited periods, it shows a more established thematic predominance in FLCL than in FLLE, given that the percentage of similarity between dates is higher in the former than in the latter, there being similarities between the years 2017-2018 and 2018-2019. Likewise, an evolution of key words is observed from the beginning established until the year 2018, in which there is a slight decrease in FLCL and –very similar– in FLLE (figura 2).

Continuity of keywords between contiguous periods.
Figura 2
Continuity of keywords between contiguous periods.

Note: (a) FLCL; (b) FLLE.

Fuente: own elaboration.

As shown in Cuadro 13, in relation to FLCL, there is a thematic plurality in the different established periods, given the variety in the research reported in this field of knowledge, but with a continuous line between periods, if we bear in mind the different bibliometric indicators. Specifically, in 2014 and 2015 the concept with the most indices was ”blended learning”, while from 2016 to 2018 the ”flipped classroom” theme is included in the witness. It is in 2019 that a radical change in research perspectives is shown, with new topics and new lines of study being offered.

Cuadro 13
Thematic performance in FLCL.
Period 2011-2013
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Education10575.9217.75481
Classroom21112.657
Problem based learning222211.22101
Period 2014
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Model444418.97242
On-line7565.489.22263
Inverted classroom16586.3212.25406
Blended learning12586.3220.12472
MOOC200000
School21111.412
Period 2015
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Quality31114.6922
First Year Undergraduate108108.9411.31166
Blended learning42122015.4918433
Students1691411.2219.21855
Active learning137139.5410.91264
Technology11232.453.7410
Physiology32227.4830
Collaboration300000
MOOC4232.454.4713
Period 2016
DenominaciónWorksh-indexg-indexhg-indexq2-indexCitations
Flipped classroom12616252022.27799
Performance21111713.6714.46319
Student performance1581510.9518.55364
Classroom103105.489.49229
Design44445.6640
Learning5232.454.925
College English500000
Period 2017
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Medical education28111713.6712.85328
Flipped classroom201121915.117.32600
Experience2581310.211.31193
Classroom21464.96.6352
Flipped learning17596.716.7183
Learning52222.456
Design7242.833.7417
Student centered learning300000
MOOC11343.463.8720
Period 2018
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Flipped classroom163797.947.48246
Impact13454.474.936
Motivation31364.245.259
Skills22343.463.8736
Perceptions164444.934
Outcomes8354.246.4847
Flipped learning611113
Learning management systems411111
Learners4121.41310
College English411124
Period 2019
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Motivation41464.96.3250
Design58464.96.6363
Curriculum21253.166.4831
Technology23232.453.1612
Model16232.453.1611
Active-learning1422226
Perceptions142222.837
Principles51111.412
Medical education600000
Student performance61111.412
Learning strategies211124
ICT31111.412
Strategies311112
Courses200000
Fuente: own elaboration.

With respect to FLLE, like its homonym, it also offers thematic varieties in the various defined periods (cuadro 14), but with a line established if bibliometric indicators are taken into account. From 2012 to 2016, the main concept is ”flipped classroom”, becoming in 2017 ”university” and in 2018 ”flipped learning”. In the data recorded to date, the year 2019 offers new perspectives and trends in research, focusing on ”performance”, “classroom model” and ”motivation”.

Cuadro 14
Thematic performance in FLLE.
Period 2012-2015
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Classroom6343.4611.09118
Flipped classroom20395.25.296
Environment333314.9220
Pedagogy21111.412
Organic-Chemistry33336.7190
Period 2016
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Achievement333311.87113
Environment33338.66112
Engineering education211111
Flipped classroom115107.078.06108
Experience22229.753
Period 2017
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
On line academic help seeking22223.168
Student Centered learning6464.95.6636
Motivation65556.3263
University7676.487.7573
Students15586.327.4266
Student performance8464.96.3245
Flipped learning21575.926.3265
Education311111
Mobile technology21112.657
Collaborative learning21111.412
Period 2018
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Middle school52224.4714
Percepctions611124
Design9343.463.8722
Learning analytics7121.4127
Educational technology4121.4125
Flipped learning30353.873.8731
Flipped classroom11232.453.1612
Video200000
Learners21111.733
Innovation200000
Period 2019
DenominationWorksh-indexg-indexhg-indexq2-indexCitations
Classroom model52225.8319
Performance15242.835.8322
Satisfaction72222.456
Flipped learning201111.733
Motivation62225.8319
Medical Education200000
Learners311111
Fuente: own elaboration.

Analyzing the different diagrams of the periods established in the FLCL, it can be observed that ”flipped classroom” is the theme that has been the most established in time, given that it has been a relevant theme from 2016 to 2018, continuing -in the same way- in the studies that are developed, focused mainly on ”Blended learning”, ”Higher education”, ”students” and ”active learning”. In recent years (2018-2019), there has been a growing trend in aspects related to motivation, impact on students and performance. As shown in both periods, attention should be paid to the topics ”ICT”, ”strategies”, ”student performance” and ”medical education”, as they are concepts whose durability implies a mystery, and may disappear in the future or emerge as driving themes (figuras 3a a 3g).

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(a) Period 2011–2013.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(b) Period 2014.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(c) Period 2015.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(d) Period 2016.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(e) Period 2017.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(f) Period 2018.

Fuente: own elaboration.

Strategic diagram by FLCL h-index.
Figura 3
Strategic diagram by FLCL h-index.

(g) Period 2019.

Fuente: own elaboration.

In the strategic diagrams of the dates configured for FLLE –in contrast to what happened with FLLE– there is no motor theme settled in time, showing changes in each of the periods. The only theme that repeats as the driving theme is ”motivation”, which appears in 2017 and 2019, although with different research perspectives, given that in 2017, the research focuses on oral training, technology, reading, class models, language students, collaboration and acceptance by users; while in 2019, it is associated with classroom approach, blended learning, self regulated learning perceptions e-learning, skills and achievement. For the coming years, the themes of ”motivation” and ”learners” should be taken into consideration, given that their location in the diagram places them as emerging or disappearing themes (figuras 4a a 4d).

Strategic diagram by FLLE h-index.
Figura 4
Strategic diagram by FLLE h-index.

(a) Period 2012–2015.

Fuente: own elaboration.

Strategic diagram by FLLE h-index.
Figura 4
Strategic diagram by FLLE h-index.

(b) Period 2016.

Fuente: own elaboration.

Strategic diagram by FLLE h-index.
Figura 4
Strategic diagram by FLLE h-index.

(c) Period 2017.

Fuente: own elaboration.

Strategic diagram by FLLE h-index.
Figura 4
Strategic diagram by FLLE h-index.

(d) Period 2018.

Fuente: own elaboration.

Strategic diagram by FLLE h-index
Figura 4
Strategic diagram by FLLE h-index

(e) Period 2019.

Fuente: own elaboration.

3.3 Thematic evolution of terms

Considering the thematic evolution shown in figuras 5a y 5b, attention should be paid to the type of line of connections made. The solid line shows a conceptual relationship and the dashed line reflects a non-conceptual relationship, given that the connection is through key words.

Thematic evolution by h-index.
Figura 5
Thematic evolution by h-index.

(a) FLCL.

Fuente: own elaboration.

Thematic evolution by h-index.
Figura 5
Thematic evolution by h-index.

(b) FLLE.

Fuente: own elaboration.

In FLCL, there is no constant line from the beginning of the research in the established field until now, there are conceptual gaps between the marked periods. The themes ”blended learning”, ”design”, ”learning”, ”MOOC” offer thematic connections and reveal continuity in at least two established periods, while ”flipped classroom” is the one that shows itself to be more constant in time and with greater thematic connection force. Likewise, the connecting force maintained by ”MOOC” and ”College English” between the 2017 and 2018 periods is one of the highest that is reflected throughout the period analysed. With respect to the rest of the connections, there are quite a number of links –both conceptual and non-conceptual– between the established periods, although these connections are with different concepts, offering a constant and variable line on the part of the scientific community.

FLLE shows an analogous circumstance, with conceptual gaps between the established periods, with the ”flipped learning” theme marking a constant and conceptual trend from the 2017 period to the present. The established connections, both conceptual and non-conceptual, present a low relationship strength. Nevertheless, there are many connections between diverse themes, which mark the constant and variable tendency in the experts of this field of knowledge.

3.4 Authors with the highest relevance index

As for the authors, and bearing in mind all the years of production, there is a variety of authorship according to the field of study observed (Figuras 6a y 6b). In this case, in FLCL the most relevant authors –given their location in the diagram– are Lyons, M., Rodríguez, M. and Jeong, J.M., while in FLLE are Rajalekshmi, K.G., Uosaki, N., and Tsai, C.W. For the next few years –due to their situation in the quadrant– Chen, N.S. and Isenhardt, I. in FLCL and Kim H.S., and Fanguy, M. in FLLE should be taken into consideration.

Strategic diagram of authors of the entire production.
Figura 6
Strategic diagram of authors of the entire production.

(a) FLCL.

Fuente: own elaboration.

Strategic diagram of authors of the entire production.
Figura 6
Strategic diagram of authors of the entire production.

(b) FLLE.

Fuente: own elaboration.

4 Discussion and Conclusions

Both flipped learning and flipped classroom are newly created teaching methodologies that are gaining more prominence among teachers and researchers (HINOJO-LUCENA y col., 2018). Its pedagogical essence is based on the inversion of the moments of learning to combine the digital and face-to-face spaces (LEE; LIM y KIM, 2017), in such a way that the instructional process begins outside the conventional classroom (BORAO MORENO y PALAU MARTÍN, 2016) when the students visualize the audiovisual content provided by the teacher (EL MIEDANY, 2019; LONG; CUMMINS y WAUGH, 2017) and continues in the classroom itself promoting project-based learning, problem solving and –in short– enhancing the attractiveness of the learning process (KOSTARIS y col., 2017).

This research has focused on providing the scientific community with the terminological standardization necessary to guide their research to relevant topics in each of the fields studied. In addition, it will allow a prior and reflective analysis of the terminological choice (FLLE or FLCL) according to the research perspective to be proposed. The added value of the study is that there is currently no study that arises or analyzes the differences between the two terms, used in certain fields and in certain branches as synonyms, although the scientific community really makes differences in its research.

Although both the concept of flipped learning and that of flipped classroom are generally used as synonyms by teachers and researchers, the results obtained in this bibliometric study differ from this usual synonymic use due to certain different markers.

The scientific output of FLCL is far superior to that of FLLE. For FLCL the type of document used by the scientists is communications, the main organization/institution is the University of North Carolina, the reference author is Keengwe, J., the source used is Advances in Social Science Education and Humanities Research and the authorship of the most cited article is McLaughlin y col. (2014). On the other hand, in FLLE, the type of document used by the scientific community to show the results is the article, the main organization is the National Taiwan University of Science Technology, the reference author is Hwang, G.J., the source is INTED Proceedings and the most cited article is by Chen, Wang y col. (2014).

Despite these concomitants, both terms share Education Educational Research as the main area of publication, English as the most widely used language and the United States as the country of reference.

The themes of studies of both concepts vary from each other. While for FLCL the relevant concept –according to the bibliometric indicators– is ”blended learning”; for FLLE the most predominant concepts are ”university” and ”flipped learning”, although they maintain a common nexus between them, ”flipped classroom”, which appears to be relevant in both terms.

Differences are also observed if relevance is taken into account by periods, where FLCL shows a more settled line, centred on the ”flipped classroom” theme, while for FLLE there is diversity between the different periods, being the ”motivation” theme the only one that is repeated at least twice.

The marked connections between themes of the different periods offer a constant line, due to the marked terminological connections between the different concepts, but variants due to conceptual gaps and continuous terminological changes. In FLCL, ”flipped classroom” is the concept that shows the greatest consistency and continuity over time; for FLLE, on the other hand, it is ”flipped learning”. Furthermore, in FLCL the conceptual connections established between themes are stronger than those marked in FLLE.

Moreover, it is pertinent to point out that the authors of greatest relevance in scientific production vary according to the field of study. While Lyons, M., Rodríguez, M. and Jeong, J.M. are for FLCL, Rajalekshmi, K.G., Uosaki, N., and Tsai, C.W. are for FLLE, not coinciding with the authors with greater production in their respective subjects. Likewise, the strategic diagrams allow us to glimpse that the authors with the greatest volume of production do not coincide with the most relevant authors for both FLCL and FLLE.

From the above, it can be concluded that FLCL and FLLE terminologies –despite being used by literature as synonyms or similar terminologies– in the scientific community are distinguished and differentiated, observing different trends and fields of study according to the concept used. In this fact lies –precisely– the prospective of the study, since it allows the scientific community to show the most appropriate fields of knowledge according to their line of research. In addition, it can be a starting point for seeking a terminological consensus that clearly delimits the field of terminology that encompasses each of the concepts analyzed.

Definitely, based on the prospect of this study, the results shown here are intended to solve an existing terminological problem in the scientific landscape. Consequently, it has been found that there are differences between the terms flipped classroom and flipped learning, so the educational community must keep both terms in mind and identify the specific connotations of each of them in order to present the results of their research. Therefore, it will allow the scientific community to know which are the main fields of research in each of the topics presented (FLLE and FLCL) and to know the main authors, the most productive countries and all the bibliometric factors related to each subject.

Among the limitations of the research is –on the one hand– the fact of compiling the diverse references and purifying the database in WoS and –on the other hand– the organizational reconstruction of the study at a temporal level, which led to new analyses and searches of the latest studies produced more immediately. Likewise, it should be noted that the results shown here have been approached from a general perspective and showing an intermediate level of specificity. Therefore, as a future line of research, it is proposed to expand the configuration of performance analysis to expand new connections and address other issues. Other notable options would be to carry out a study of a similar design, but using other relevant databases within the scientific field. In addition, it is proposed to investigate the existence of similar situations in which two concepts were applied under a synonym relationship to carry out their bibliometric study.

Referencias

ABEYSEKERA, Lakmal y DAWSON, Phillip. Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research. Higher Education Research & Development, v. 34, n. 1, p. 1-14, ene. 2015. DOI: 10.1080/07294360.2014.934336. Disponible en: http://www.tandfonline.com/doi/abs/10.1080/07294360.2014.934336. Acceso en: 5 mar. 2021.

AHMED, Hanaa Ouda Khadri. Flipped learning as a new educational paradigm: an analytical critical study. European Scientific Journal, ESJ, v. 12, n. 10, p. 417-417, abr. 2016. DOI: 10.19044/esj.2016.v12n10p417. Disponible en: https://eujournal.org/index.php/esj/article/view/7335. Acceso en: 5 mar. 2021.

AWIDI, Isaiah T. y PAYNTER, Mark. The impact of a flipped classroom approach on student learning experience. Computers & Education, v. 128, p. 269-283, ene. 2019. ISSN 03601315. DOI: 10.1016/j.compedu.2018.09.013. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131518302495. Acceso en: 5 mar. 2021.

BÁEZ PÉREZ, Carmen Inés y CLUNIE BEAUFOND, Clifton Eduardo. Una mirada a la Educación Ubicua. RIED. Revista Iberoamericana de Educación a Distancia, v. 22, n. 1, pág. 325, ene. 2019. DOI: 10.5944/ried.22.1.22422. Disponible en: http://revistas.uned.es/index.php/ried/article/view/22422. Acceso en: 5 mar. 2021.

BAUER-RAMAZANI, Christine y col. Flipped Learning in TESOL: Definitions, Approaches, and Implementation. TESOL Journal, v. 7, n. 2, p. 429-437, jun. 2016. DOI: 10.1002/tesj.250. Disponible en: http://doi.wiley.com/10.1002/tesj.250. Acceso en: 5 mar. 2021.

BERGMANN, Jonathan y SAMS, Aaron. Flip your classroom: reach every student in every class every day. Eugene, Or: International Society for Technology in Education, 2012.

BLAIR, Erik; MAHARAJ, Chris y PRIMUS, Simone. Performance and perception in the flipped classroom. Education and Information Technologies, v. 21, n. 6, p. 1465-1482, nov. 2016. DOI: 10.1007/s10639-015-9393-5. Disponible en: http://link.springer.com/10.1007/s10639-015-9393-5. Acceso en: 5 mar. 2021.

BLAU, Ina y SHAMIR-INBAL, Tamar. Re-designed flipped learning model in an academic course: The role of co-creation and co-regulation. Computers & Education, v. 115, p. 69-81, dic. 2017. DOI: 10.1016/j.compedu.2017.07.014. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S036013151730177X. Acceso en: 5 mar. 2021.

BOELENS, Ruth; VOET, Michiel y DE WEVER, Bram. The design of blended learning in response to student diversity in higher education: Instructors’ views and use of differentiated instruction in blended learning. Computers & Education, v. 120, p. 197-212, mayo 2018. DOI: 10.1016/j.compedu.2018.02.009. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131518300423. Acceso en: 5 mar. 2021.

BOGNAR, Branko; SABLIĆ, Marija y ŠKUGOR, Alma. Flipped Learning and Online Discussion in Higher Education Teaching. In: DANIELA, Linda (Ed.). Didactics of Smart Pedagogy. Cham: Springer International Publishing, 2019. P. 371-392. DOI: 10.1007/978-3-030-01551-0˙19. Disponible en: http://link.springer.com/10.1007/978-3-030-01551-0_19. Acceso en: 5 mar. 2021.

BORAO MORENO, Laura y PALAU MARTÍN, Ramon Félix. Análisis de la implementación de Flipped Classroom en las asignaturas instrumentales de 4º Educación Secundaria Obligatoria. Edutec. Revista Electrónica de Tecnología Educativa, n. 55, mar. 2016. DOI: 10.21556/edutec.2016.55.733. Disponible en: http://www.edutec.es/revista/index.php/edutec-e/article/view/733. Acceso en: 5 mar. 2021.

BRAVO, Isabel del Arco; ALARCIA, Óscar Flores y GARCÍA, Patricia Silva. El desarrollo del modelo flipped classroom en la universidad: impacto de su implementación desde la voz del estudiantado. Revista de Investigación Educativa, v. 37, n. 2, p. 451-469, jun. 2019. DOI: 10.6018/rie.37.2.327831. Disponible en: https://revistas.um.es/rie/article/view/327831. Acceso en: 5 mar. 2021.

CABI, Emine. The Impact of the Flipped Classroom Model on Students’ Academic Achievement. The International Review of Research in Open and Distributed Learning, v. 19, n. 3, jul. 2018. DOI: 10.19173/irrodl.v19i3.3482. Disponible en: http://www.irrodl.org/index.php/irrodl/article/view/3482. Acceso en: 5 mar. 2021.

CASTELLANOS SÁNCHEZ, Almudena; SÁNCHEZ ROMERO, Cristina y CALDERERO HERNÁNDEZ, José Fernando. Nuevos modelos tecnopedagógicos. Competencia digital de los alumnos universitarios. Revista Electrónica de Investigación Educativa, v. 19, n. 1, pág. 1, ene. 2017. DOI: 10.24320/redie.2017.19.1.1148. Disponible en: http://redie.uabc.mx/redie/article/view/1148. Acceso en: 5 mar. 2021.

CHEN, Chun-Kuei; HUANG, Neng-Tang Norman y HWANG, Gwo-Jen. Findings and implications of flipped science learning research: A review of journal publications. Interactive Learning Environments, p. 1-18, nov. 2019. DOI: 10.1080/10494820.2019.1690528. Disponible en: https://www.tandfonline.com/doi/full/10.1080/10494820.2019.1690528. Acceso en: 5 mar. 2021.

CHEN, Yunglung; WANG, Yuping y col. Is FLIP enough? Or should we use the FLIPPED model instead? Computers & Education, v. 79, p. 16-27, oct. 2014. ISSN 03601315. DOI: 10.1016/j.compedu.2014.07.004. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131514001559. Acceso en: 5 mar. 2021.

CHYR, Wen-Li y col. Exploring the Effects of Online Academic HelpSeeking and Flipped Learning on Improving Students’ Learning. Educational Technology & Society, v. 20, n. 3, p. 11-23, 2017. Disponible en: https://pdfs.semanticscholar.org/9431/67d5104f67c9ce4361e07332ef784a3c27a2.pdf.

COBO, M.J. y col. Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for Information Science and Technology, v. 62, n. 7, p. 1382-1402, jul. 2011. DOI: 10.1002/asi.21525. Disponible en: http://doi.wiley.com/10.1002/asi.21525. Acceso en: 5 mar. 2021.

DELOZIER, Sarah J. y RHODES, Matthew G. Flipped Classrooms: a Review of Key Ideas and Recommendations for Practice. Educational Psychology Review, v. 29, n. 1, p. 141-151, mar. 2017. DOI: 10.1007/s10648-015-9356-9. Disponible en: https://doi.org/10.1007/s10648-015-9356-9. Acceso en: 5 mar. 2021.

EL MIEDANY, Yasser. Flipped Learning. In: RHEUMATOLOGY Teaching. Cham: Springer International Publishing, 2019. P. 285-303. DOI: 10.1007/978-3-319-98213-7˙15. Disponible en: http://link.springer.com/10.1007/978-3-319-98213-7_15. Acceso en: 5 mar. 2021.

FISHER, Rosemary y col. Flipped learning, flipped satisfaction, getting the balance right. Teaching & Learning Inquiry, v. 5, n. 2, pág. 114, sep. 2017. DOI: 10.20343/teachlearninqu.5.2.9. Disponible en: https://journalhosting.ucalgary.ca/index.php/tli/article/view/57358. Acceso en: 5 mar. 2021.

FROEHLICH, Dominik Emanuel. Non-Technological Learning Environments in a Technological World: Flipping Comes To The Aid. Journal of New Approaches in Educational Research, v. 7, n. 2, p. 88-92, jul. 2018. DOI: 10.7821/naer.2018.7.304. Disponible en: https://naerjournal.ua.es/article/view/v7n2-2. Acceso en: 5 mar. 2021.

HE, Wenliang y col. The effects of flipped instruction on out-of-class study time, exam performance, and student perceptions. Learning and Instruction, v. 45, p. 61-71, oct. 2016. DOI: 10.1016/j.learninstruc.2016.07.001. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0959475216300664. Acceso en: 5 mar. 2021.

HINOJO LUCENA, Francisco J. y col. Influencia del aula invertida en el rendimiento académico. Una revisión sistemática. Campus Virtuales, v. 8, n. 1, p. 9-18, 2019. Disponible en: http://www.uajournals.com/campusvirtuales/journal/14/1.pdf.

HINOJO-LUCENA, Francisco y col. Incidence of the Flipped Classroom in the Physical Education Students’ Academic Performance in University Contexts. Sustainability, v. 10, n. 5, pág. 1334, abr. 2018. DOI: 10.3390/su10051334. Disponible en: http://www.mdpi.com/2071-1050/10/5/1334. Acceso en: 5 mar. 2021.

HIRSCH, J. E. An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences, v. 102, n. 46, p. 16569-16572, nov. 2005. DOI: 10.1073/pnas.0507655102. Disponible en: http://www.pnas.org/cgi/doi/10.1073/pnas.0507655102. Acceso en: 5 mar. 2021.

HUANG, Biyun; HEW, Khe Foon y LO, Chung Kwan. Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, v. 27, n. 8, p. 1106-1126, nov. 2019. DOI: 10.1080/10494820.2018.1495653. Disponible en: https://www.tandfonline.com/doi/full/10.1080/10494820.2018.1495653. Acceso en: 5 mar. 2021.

HWANG, Gwo-Jen; LAI, Chiu-Lin y WANG, Siang-Yi. Seamless flipped learning: a mobile technology-enhanced flipped classroom with effective learning strategies. Journal of Computers in Education, v. 2, n. 4, p. 449-473, dic. 2015. DOI: 10.1007/s40692-015-0043-0. Disponible en: http://link.springer.com/10.1007/s40692-015-0043-0. Acceso en: 5 mar. 2021.

KAZANIDIS, Ioannis y col. Can the flipped classroom model improve students’ academic performance and training satisfaction in Higher Education instructional media design courses? British Journal of Educational Technology, v. 50, n. 4, p. 2014-2027, jul. 2019. DOI: 10.1111/bjet.12694. Disponible en: https://onlinelibrary.wiley.com/doi/abs/10.1111/bjet.12694. Acceso en: 5 mar. 2021.

KOSTARIS, Christoforos y col. Investigating the potential of the Flipped Classroom Model in K-12 ICT teaching and learning: an action research study. Educational Technology & Society, v. 20, n. 1, p. 261-273, 2017.

KWON, Jung Eon y WOO, Hyung Rok. The impact of Flipped Learning on cooperative and competitive mindsets. Sustainability, v. 10, n. 1, p. 1-15, 2018. ISSN https://doi.org/10.3390/su10010079. DOI: 10.3390/su10010079.

LEE, Jihyun; LIM, Cheolil y KIM, Hyeonsu. Development of an instructional design model for flipped learning in higher education. Educational Technology Research and Development, v. 65, n. 2, p. 427-453, abr. 2017. DOI: 10.1007/s11423-016-9502-1. Disponible en: http://link.springer.com/10.1007/s11423-016-9502-1. Acceso en: 5 mar. 2021.

LEE, Jihyun; PARK, Taejung y DAVIS, Robert Otto. What affects learner engagement in flipped learning and what predicts its outcomes?: FL engagement and outcomes. British Journal of Educational Technology, nov. 2018. DOI: 10.1111/bjet.12717. Disponible en: http://doi.wiley.com/10.1111/bjet.12717. Acceso en: 5 mar. 2021.

LLANOS GARCIA, Gonzalo y BRAVO-AGAPITO, Javier. Flipped classroom como puente hacia nuevos retos en la educación primaria. Revista Tecnología, Ciencia y Educación, n. 8, p. 39-49, 2019. Disponible en: http://www.revistasocitec.org/index.php/TCE/article/download/153/125.

LONG, Taotao; CUMMINS, John y WAUGH, Michael. Use of the flipped classroom instructional model in higher education: instructors’ perspectives. Journal of Computing in Higher Education, v. 29, n. 2, p. 179-200, ago. 2017. DOI: 10.1007/s12528-016-9119-8. Disponible en: http://link.springer.com/10.1007/s12528-016-9119-8. Acceso en: 5 mar. 2021.

LÓPEZ-BELMONTE, Jesús; MORENO-GUERRERO, Antonio-José y col. Analysis of the Productive, Structural, and Dynamic Development of Augmented Reality in Higher Education Research on the Web of Science. Applied Sciences, v. 9, n. 24, pág. 5306, dic. 2019b. DOI: 10.3390/app9245306. Disponible en: https://www.mdpi.com/2076-3417/9/24/5306. Acceso en: 12 mar. 2021.

LÓPEZ-BELMONTE, Jesús; POZO SÁNCHEZ, Santiago y col. Creación de contenidos y flipped learning: un binomio necesario para la educación del nuevo milenio. Revista Española de Pedagogía, v. 77, n. 274, p. 535-555, sep. 2019. DOI: 10.22550/REP77-3-2019-07. Disponible en: https://revistadepedagogia.org/lxxvii/no-274/creacion-de-contenidos-y-flipped-learning-un-binomio-necesario-para-la-educacion-del-nuevo-milenio/101400075517/. Acceso en: 12 mar. 2021.

LÓPEZ-ROBLES, José-Ricardo y col. El profesional de la información (EPI): Bibliometric and thematic analysis (2006-2017). El Profesional de la Información, v. 28, n. 4, ago. 2019. DOI: 10.3145/epi.2019.jul.17. Disponible en: https://revista.profesionaldelainformacion.com/index.php/EPI/article/view/epi.2019.jul.17. Acceso en: 5 mar. 2021.

MACLEOD, Jason y col. Technological factors and student-to-student connected classroom climate in cloud classrooms. Journal of Educational Computing Research, v. 56, n. 6, p. 826-847, oct. 2018. DOI: 10.1177/0735633117733999. Disponible en: http://journals.sagepub.com/doi/10.1177/0735633117733999. Acceso en: 5 mar. 2021.

MARTÍNEZ, Ma Angeles y col. Analyzing the Scientific Evolution of Social Work Using Science Mapping. Research on Social Work Practice, v. 25, n. 2, p. 257-277, mar. 2015. DOI: 10.1177/1049731514522101. Disponible en: http://journals.sagepub.com/doi/10.1177/1049731514522101. Acceso en: 5 mar. 2021.

MCLAUGHLIN, Jacqueline E. y col. The Flipped Classroom: a course redesign to foster learning and engagement in a health professions school. Academic Medicine, v. 89, n. 2, p. 236-243, feb. 2014. DOI: 10.1097/ACM.0000000000000086. Disponible en: http://journals.lww.com/00001888-201402000-00017. Acceso en: 5 mar. 2021.

MCNALLY, Brenton y col. Flipped classroom experiences: student preferences and flip strategy in a higher education context. Higher Education, v. 73, n. 2, p. 281-298, feb. 2017. DOI: 10.1007/s10734-016-0014-z. Disponible en: http://link.springer.com/10.1007/s10734-016-0014-z. Acceso en: 5 mar. 2021.

MINGORANCE ESTRADA, Ángel Custodio y col. Mejora del rendimiento académico a través de la metodología de aula invertida centrada en el aprendizaje activo del estudiante universitario deficiencias de la educación. Journal of Sport and Health Research, v. 9, n. 1, p. 129-136, 2017. Disponible en: http://www.journalshr.com/papers/Vol%5C%209_suplemento/JSHR%5C%20V09_supl_05.pdf.

MIÑO-PUIGCERCÓS, Raquel; DOMINGO-COSCOLLOLA, María y SANCHO-GIL, Juana M. Transforming the teaching and learning culture in higher education from a DIY perspective. Educación XX1, v. 22, n. 1, nov. 2018. DOI: 10.5944/educxx1.20057. Disponible en: http://revistas.uned.es/index.php/educacionXX1/article/view/20057. Acceso en: 5 mar. 2021.

MOK, Heng Ngee. Teaching tip: the Flipped Classroom. Journal of Information Systems Education, v. 25, n. 1, p. 7-11, 2014. Disponible en: https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?referer=https://scholar.google.com/&httpsredir=1&article=3363&context=sis_research.

MORTENSEN, C. J. y NICHOLSON, A. M. The flipped classroom stimulates greater learning and is a modern 21st century approach to teaching today’s undergraduates. Journal of Animal Science, v. 93, n. 7, p. 3722-3731, jul. 2015. DOI: 10.2527/jas.2015-9087. Disponible en: https://academic.oup.com/jas/article/93/7/3722/4701924. Acceso en: 5 mar. 2021.

NOURI, Jalal. The flipped classroom: for active, effective and increased learning – especially for low achievers. International Journal of Educational Technology in Higher Education, v. 13, n. 1, pág. 33, dic. 2016. DOI: 10.1186/s41239-016-0032-z. Disponible en: http://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-016-0032-z. Acceso en: 5 mar. 2021.

PEREIRA, Sara; FILLOL, Joana y MOURA, Pedro. Young people learning from digital media outside of school: The informal meets the formal. Comunicar, v. 27, n. 58, p. 41-50, ene. 2019. DOI: 10.3916/C58-2019-04. Disponible en: https://www.revistacomunicar.com/index.php?contenido=detalles&numero=58&articulo=58-2019-04. Acceso en: 5 mar. 2021.

ROMERO, María del Carmen; BUZÓN-GARCÍA, Olga y TOURON, Javier. The flipped learning model in online based education for secondary teachers. Journal of Technology and Science Education, v. 9, n. 2, pág. 109, mar. 2019. DOI: 10.3926/jotse.435. Disponible en: http://www.jotse.org/index.php/jotse/article/view/435. Acceso en: 5 mar. 2021.

SACRISTÁN SAN CRISTÓBAL, Mara y col. Flipped classroom y didáctica de las matemáticas en la formación online de Maestros de Educación Infantil. Revista Electrónica Interuniversitaria de Formación del Profesorado, v. 20, n. 3, pág. 1, jul. 2017. DOI: 10.6018/reifop.20.3.292551. Disponible en: http://revistas.um.es/reifop/article/view/292551. Acceso en: 5 mar. 2021.

SHIH, Wen-Ling y TSAI, Chun-Yen. Students’ perception of a flipped classroom approach to facilitating online project-based learning in marketing research courses. Australasian Journal of Educational Technology, dic. 2016. DOI: 10.14742/ajet.2884. Disponible en: http://ajet.org.au/index.php/AJET/article/view/2884. Acceso en: 5 mar. 2021.

SOLA MARTÍNEZ, Tomás y col. Eficacia del Método Flipped Classroom en la universidad: meta-análisis de la producción científica de impacto. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, v. 17, n. 1, pág. 25, dic. 2019. DOI: 10.15366/reice2019.17.1.002. Disponible en: https://revistas.uam.es/index.php/reice/article/view/10432. Acceso en: 5 mar. 2021.

THAI, Ngoc Thuy Thi; DE WEVER, Bram y VALCKE, Martin. The impact of a flipped classroom design on learning performance in higher education: Looking for the best “blend” of lectures and guiding questions with feedback. Computers & Education, v. 107, p. 113-126, abr. 2017. DOI: 10.1016/j.compedu.2017.01.003. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131517300039. Acceso en: 5 mar. 2021.

TOURÓN, Javier y SANTIAGO, Raúl. El modelo Flipped learning y el desarrollo del talento en la escuela. Revista de educación, n. 368, p. 196-231, 2015. Disponible en: https://sede.educacion.gob.es/publiventa/detalle.action?cod=20325.

TSE, Wai S.; CHOI, Lai Y. A. y TANG, Wing S. Effects of video-based flipped class instruction on subject reading motivation: Flipped class instruction. British Journal of Educational Technology, v. 50, n. 1, p. 385-398, ene. 2019. DOI: 10.1111/bjet.12569. Disponible en: http://doi.wiley.com/10.1111/bjet.12569. Acceso en: 5 mar. 2021.

UNIVERSITY OF OTAGO WELLINGTON, NEW ZEALAND y col. “Just tell me what I need to know to pass the exam!” Can active flipped learning overcome passivity? The Asia Pacific Scholar, v. 2, n. 1, p. 1-6, ene. 2017. DOI: 10.29060/TAPS.2017-2-1/OA1007. Disponible en: https://medicine.nus.edu.sg/taps/just-tell-me-what-i-need-to-know-to-pass-the-exam-can-active-flipped-learning-overcome-passivity/. Acceso en: 5 mar. 2021.

WU, Wen-Chi Vivian; HSIEH, Jun Scott Chen y YANG, Jie Chi. Creating an online Learning community in a Flipped Classroom to enhance EFL learners’ Oral Proficiency. Educational Technology & Society, v. 20, n. 2, p. 142-157, 2017. Disponible en: https://eric.ed.gov/?id=EJ1137524.

YILMAZ, Ramazan. Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classroom. Computers in Human Behavior, v. 70, p. 251-260, mayo 2017. DOI: 10.1016/j.chb.2016.12.085. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0747563216309141. Acceso en: 5 mar. 2021.

YOSHIDA, Hiroki. Perceived usefulness of ”Flipped Learning” on instructional design for elementary and secondary education: with focus on pre-service Teacher education. International Journal of Information and Education Technology, v. 6, n. 6, p. 430-434, 2016. DOI: 10.7763/IJIET.2016.V6.727. Disponible en: http://www.ijiet.org/show-73-816-1.html. Acceso en: 5 mar. 2021.

ZAINUDDIN, Zamzami y col. How do students become self-directed learners in the EFL flipped-class pedagogy? A study in higher education. Indonesian Journal of Applied Linguistics, v. 8, n. 3, pág. 678, ene. 2019. DOI: 10.17509/ijal.v8i3.15270. Disponible en: http://ejournal.upi.edu/index.php/IJAL/article/view/15270. Acceso en: 5 mar. 2021.

HTML generado a partir de XML-JATS4R por