Slowing the brain drain: FAIMER education programs

WILLIAM P. BURDICK, PAGE S. MORAHAN & JOHN J. NORCINI 

Foundation for Advancement of International Medical Education and Research, Philadelphia, USA






Introduction

- 개발도상국에서 의사인력의 유출(migration)은 세계 곳곳에서 심각한 의료인력부족을 낳고 있음.

- Migration의 충격 : 교육받은 시민의 손실, 의료공금자의 손실, BME, GME에서 연구역량과 교사의 손실

- 두뇌유출을 늦추는 것은 복잡한 노력이 필요하나 다양한 노력을 통해서 줄여나갈 수 있다.

- 양질의 미국 의학교육은 GME단계에서 많은 인력을 끌어당기고 있다. 그리고 이들은 수련을 마친 후에도 미국에 남는 경우가 많다.

- FAIMER는 ECFMG(Educational Commission for Foreign Medical Graduates)의 supporting corporation으로서 지난 5년간 교수개발 프로그램을 만들어서 해외 의학교육을 강화시키고, 진로발전을 도움으로써 의료인력이 부족한 국가의 공급을 늘리는데 기여하고자 했다.

Migration of physicians from developing countries has created serious shortages of medical manpower in many parts of the world (Marchal & Kegels, 2003; Mullan, 2005). The impact of migration on donor countries includes loss of educated citizens, healthcare service providers, research capacity and teachers at the undergraduate and postgraduate medical level (Aluwihare, 2005). Slowing the brain drain is a complex endeavor but developing skills, creating professional networks and enhancing opportunities for career advancement of physicians may be an important element in diminishing out-migration. The attraction of high-quality US medical education, and especially graduate medical education, has drawn thousands of foreign physicians to postgraduate training programs in the US (Whelan, 2002). After training is complete, many of these individuals are granted visa waivers by federal or state agencies and stay to practice medicine in the US. The Foundation for Advancement of International Medical Education and Research (FAIMER), a supporting corporation of the Educational Commission for Foreign Medical Graduates, has created faculty development programs over the past five years to strengthen medical education and career advancement for medical educators overseas, thus supporting the expanded production of physicians in those countries where there is an undersupply.


- FAIMER의 교육 프로그램은 세 부분으로 이루어져 있다. 

FAIMER's education program has three components. 

  • The FAIMER Institute, started in 2001, awards a two-year fellowship focused on educational leadership and methodology. It consists of two brief residential experiences in the US integrated with distance learning (Norcini et al., 2005). 
  • The International Fellowships in Medical Education (IFME) program is an advanced-level fellowship that funds selected graduates of the Institute to obtain a master's in medical education at academic institutions around the world. 
  • Most recently, FAIMER has begun to develop regional institutes in other parts of the world based on the principles embedded in the original FAIMER Institute. The purpose of this paper is to present the goals of the program, describe the components in detail, present data concerning their efficacy and outline plans for the future.



Goal

- FAIMER프로그램의 최종 목적은 개발도상국에 지속가능한 의학교육Discipline을 구축하여 해당 국가의 의학교육을 가능하게 하는 것이다. 

- 강력한 의학교육 시스템의 효과는 몇 가지로 나눠볼 수 있다. (BME, GME, CPD)

The overarching goal of the FAIMER education program is to strengthen medical education and help build a sustainable discipline of medical education in developing countries. The effects of a stronger medical education system are several. 

    • At the undergraduate medical education level, there is the possibility that it may attract higher quality students to the field and improve their rate of retention; increased attraction and retention has been shown in US medical schools (Milbank, 2005). 
    • The development of local high-quality postgraduate education will enhance opportunities for completing medical training in their home country. 
    • Strong systems for undergraduate and postgraduate education are likely to create an impetus for continuous professional development, further increasing the attractiveness of practicing medicine in their home country. 


- 개발도상국에게 의학교육 원칙(discipline of medical education)을 확립하게 하는 전략으로는 다음과 같은 것이 있으며, 최종적인 효과는 양질의 의사를 양성하여 그 지역 인구의 건강을 증진하는 것이다.

Strategies for facilitating development of the discipline of medical education in developing countries include: 

    • creating a critical mass of educators and supporting the interaction of these individuals, 
    • providing access to educational resources
    • developing leaders in medical education, and 
    • encouraging and facilitating scholarly work in this domain. 


The net effect of these efforts should be to increase the production of high-quality physicians likely to serve populations in their country of training, thereby improving the health of the population.


- FAIMER의 교육 프로그램은 남아시아, 아프리카, 남아메리카를 주요 대상으로 하며, 이들 대상이 선정된 주요 근거는 다음과 같다. 그러나 이들 지역 외 지역에서도 매년 지원자가 있다.

FAIMER's educational programs currently focus on South Asia, Africa and South America. These regions were chosen based on 

    • (1) need, 
    • (2) stability and accessibility, 
    • (3) the capacity to use and sustain the resources FAIMER contributes and 
    • (4) the number of former Fellows in the area. 

Applications from other regions, however, are accepted each year.




FAIMER education programs

FAIMER Institute

FAIMER Institute는 gateway 프로그램으로서, 여기에 지원하는 사람들은 영어를 유창하게 할 수 있어야 하며, 지원 시점, 합격 시점, Fellowship진행 과정 동안 본국에서 거주하며 근무중이어야 한다. 이 지원의 핵심 요소는 교육과정혁신프로젝트(Curriculum innovation project)이며, 지원자가 이 프로젝트를 작성하면 단/장기 적으로 평가받게 된다.

The FAIMER Institute is the gateway program for education activities. Applicants for the Institute, who are required to speak English at a high level of proficiency, must reside and work in their home countries at the time of application, acceptance and duration of the Fellowship award. Central to the application is a curriculum innovation project in which the applicant describes the purpose of the innovation, how the change would be implemented, and how the success of the project would be evaluated in the short and long term. The curriculum innovation project becomes the vehicle for learning about concepts of leadership and education methodology.


2년짜리 프로그램인 FAIMER Institute는 매년 16명의 참가자가 있으며 4세션으로 진행된다. 두 세션은 미국에 머물며 진행되고 두 세션은 원거리 학습을 한다.

The two-year program, with 16 participants each year, includes four sessions—two residential in the United States and two distance learning. 

세션1 : 첫 번째 세션은 세 가지 주제로 구성되어 있다.

During Session 1, a three-week residential component, there are three curriculum strands

Fellows acquire basic skills in medical education, including large-group teaching, problem-based learning, student assessment and program evaluation. 

Fellows also gain skills in leadership and management. 

These include: assessment and understanding of their own leadership style and how to use that insight when working with others, project management tools, managing change processes, handling conflict, understanding group dynamics, the nature of high performance teams, and appreciative leadership (Dorsey, 2000; Bushe, 2001; Burns, 2003). 

The third strand encompasses building a strong community of practice (Wenger et al., 2002). Fellows are involved in a variety of methods to create community, including sharing their professional ‘stories’ (Wheatley, 2005) learning about the concept of social capital and how communities of practice are built and maintained (Baker, 2000; Abrahamson, 2004) and experiencing the role of co-mentoring. To make learning concrete and meaningful, the Fellow's project is the focus of special attention throughout the session. Individual, small-group and large-group discussions are used, as is feedback from peers and experts. The goal is for the Fellows to refine their projects and be ready to implement them on their return home.


세션2 : 첫 번째 미국내 세션이 끝나면, 연수생들은 본국으로 돌아가서 프로젝트를 수행하면서 두 번째 세션에 참가하는데 이 때는 인터넷을 활용한 멘토링과 원거리 학습 프로그램이 이용된다.

After the first residential session, the Fellows return home to conduct their projects and participate in Session 2, a mentoring and distance-learning program on the Internet (Mentoring and Learning Web, or ML-Web). During Session 2, they are co-mentored by a second-year fellow and a Global Faculty Adviser (selected from previous graduates). 


세션3 : 1년차의 마지막 2주를 다시 미국으로 돌아와서 advanced 과정을 밟고 co-mentoring을 진행할 새로운 1년차 연수생과 연결된다.

The Fellows return to the US for approximately two weeks at the end of the first year for workshops on advanced leadership, management and education issues, and to connect with the first year Fellows they will be co-mentoring (Session 3). 


세션4 : 세션2의 ML-Web을 다시 활용하게 되며 학술업적을 이뤄야 한다.

In Session 4, second-year Fellows participate in the ML-Web, developing required scholarly output and co-mentoring a first-year Fellow.




FAIMER Regional Institutes

FAIMER Institute의 참가자들이 residential session 기간동안에 미국에 와야 하는 것과 달리 FAIMER RI는 개발도상국의 의과대학에서 진행되며 주변 지역에서 참가자들이 온다. 

While participants in the FAIMER Institute come to the US for residential sessions, the FAIMER Regional Institutes are conducted at medical schools in developing countries for participants from the surrounding area, using principles embedded in the FAIMER Institute. 


지난 3년간 다양한 지역 프로그램(local initiative)가 있었다. 하나는 2005년 7월에 시작했고, 다른 하나는 2006년 1월에 시작하였으며, 나머지 두 개는 현재 개발중이다.

A variety of local initiatives have been conducted over the past three years. One Regional Institute started in July 2005, another began in January 2006, and two others are currently in development. The experimental and iterative growth process involves: 

(1) full respectful partnership with the local organizers, 

(2) co-creation of a curriculum that fits the local context and needs, 

(3) local capacity regarding resources for all logistical issues, 

(4) commitment by local organizer to facilitate FAIMER networking in the region through participation of FAIMER Institute graduates as faculty, and 

(5) dual learning by FAIMER and the local organizing entity that informs future efforts (Plsek, 2001).



RI는 FAIMER Institute 교재를 활용하며, 미국에서 FAIMER Institute를 성공적으로 이수한 해당 지역의 교수의 리더십에 따라 진행된다. 교수진(faculty member)은 주로 그 지역에서 오며, 여기에 추가로 일부 해외 교수진이 추가된다. 첫 몇 년간은 자금을 지원해주며 그 이후는 해당 지역 참가자와 의과대학이 비용을 부담할 것으로 기대한다.

Regional institutes are created using FAIMER Institute materials, with leadership by local faculty who have completed and excelled in the Institute in the US. Faculty members are predominantly from the region, with addition of some international faculty. Funding is provided for the first several years of operation, with the expectation that local participants and their medical schools will provide ongoing funding in subsequent years.



Other regional initiatives have ranged from co-creation of medical education skill-building workshops for clinical skills assessment to co-creation of medical educator leadership and project-management workshops. These involved partnership with FAIMER faculty for curriculum design, and travel of FAIMER faculty to participate in the workshops. FAIMER faculty have also facilitated individual and collaborative medical education scholarship development through on-site consultation.


The first regional institute was started in July 2005 in Mumbai, India

Seth Gordhandas Sunderdas Medical College (GSMC) was selected because of the presence of an existing faculty development program, the involvement of an Institute graduate, the support of the medical school leadership, and the institution's outstanding reputation. The GSMC-FAIMER Regional Institute is being created from the existing faculty development program, which was approximately three days in duration. The first iteration of the regional institute transformed it into a two-year program with two five-day residential sessions, a curriculum innovation project and a distance learning component. Because of geographic proximity, several brief interim meetings, as well as on-site consultations, have been possible. The residential components will be lengthened gradually until they are each about 10 days in duration.


Education methodology workshop topics during Session 1 of the GSMC-FAIMER Regional Institute in 2006 have included the teaching and learning process, group dynamics, writing objectives, small- and large-group teaching, use of audiovisual tools and student assessment, as well as multiple-choice question formulation. Leadership and management topics have included team building, networking and change management. Significant time has been allocated to project management and educational project design, especially as related to participants’ curriculum innovation projects.


The Regional Institute in Ludhiana, India began January, 2006 at Christian Medical College—Ludhiana (CMCL). 

CMCL-FAIMER Regional Institute is under the leadership of a former Institute fellow, and includes participants from the Punjab, but also from the New Delhi, Mumbai and Bangalore areas. Faculty are from the home institution, the South Asia region, as well as from other international institutions. Development discussions are underway for additional regional institutes in Brazil and South Africa, as well as other parts of South Asia and Africa.



International Fellowships in Medical Education

승진에 필요한 연구와 학문을 위해서 뿐만 아니라 더 깊은 지식을 위해서도 고급학위(advanced degree)가 중요하다. 그러나 교육 관련 고급학위(advanced degree)가 없는 경우에 실험 또는 역학 연구 학위를 받아야 하고, 이로 인해 애초에 교육에 관심이 있었던 사람들이 멀어지게 된다.

Advanced degrees are useful for developing in-depth knowledge as well as skills in research and scholarship, which are essential for promoting a cadre of professionals in any field. In medical schools around the world, an advanced degree beyond the initial clinical medicine degree is often a prerequisite for faculty promotion. If advanced degrees in education are not available, aspiring faculty seeking promotion must pursue academic work in other areas such as bench research or epidemiology, distracting them from a possible career in medical education.


FAIMER Institute 와 Regional Institute의 졸업생은 IFME에 지원할 수 있으며, 세계 어디에서든 입학하여 원격교육을 통해 석사학위를 받을 수 있다. 연수생들은 advanced standing을 받을 수 있으며, 학위를 받을 때 까지는 3년이 걸린다. 모든 프로그램은 약간의 residential component가 있다.

Institute and regional institute graduates are eligible to apply for an International Fellowship in Medical Education award, which supports matriculation at an approved master's in education program anywhere in the world using a distance-learning format. Fellows receive slightly advanced standing for their work at the Institute, and they have three years to complete the degree. All programs have a modest residential component so that participants can create better connections with their fellow students and faculty.



Evaluation of the FAIMER education programs

FAIMER 교육 프로그램의 평가는 프로그램 평가의 logic model과 Kirkpatrick의 모델을 이용하여 정량적, 정성적 접근을 같이 하였다. 즉각적 반응은 각 워크숍 직후에 설문을 통해 평가하였으며, 지식과 태도의 변화는 'retrospective pre-methodology'를 사용하엿다. 행동의 변화는 세션3 이후 주기적으로 심층 면접을 시행하여 평가하였다. 

Evaluation of the FAIMER education programs combines qualitative and quantitative approaches, and is organized using the logic model of program evaluation (WF Kellogg) and Kirkpatrick's levels of impact (Kirkpatrick, 1994). Immediate reaction to sessions is assessed through detailed questions concerning the quality of each workshop. Change in knowledge and attitudes is assessed using ‘retrospective pre-methodology’ (Skeff, 1992). Change in behavior, as well as knowledge and attitudes, is assessed through in-depth interviews at the end of Session 3 and periodically after the conclusion of the program. Data are collected and analysed by an independent team from the University of New Mexico Office of Program Evaluation, Assessment and Research.


retrospective pre-data의 분석으로부터 모든 여덟 개 의학교육 분야에 대해서 통계적으로 유의미한 효과가 있었음을 확인하였고, 여섯 개의 리더십과 경영 분야에서 통계적으로 유의미한 효과가 있음을 확인하였다. 

Analysis of the retrospective pre-data from the first three classes has shown large, statistically significant effects in all eight areas of medical education (international medical education, educational methods, assessment of student performance, educational program evaluation, educational projects, international medical education day, distance education, qualitative evaluation methods) and all six areas of leadership and management (change theory and management, personal professional development, project management, advanced leadership, whole systems models to sustain change, electronic learning and management). These indicate the impact on Fellows’ perceptions of the importance of the areas, as well as on their self-ratings of growth in knowledge, skills and attitudes before and after the Institute.


의학교육과 리더십의 지식과 술기 향상 외에도, Institute의 주요 목적 중 하나는 개발도상국에서 의학교육의 교수개발이 중요한 원칙(recognized discipline)이 되도록 하는 것이었다. 

In addition to increasing knowledge and skills in medical education and educational leadership, a major goal of the Institute is to facilitate development of medical education as a recognized discipline in developing countries. 

Fellows are developing both individual and collaborative scholarship. In addition to an almost 100% rate of return and retention for Institute Fellows (45/46 from the first four Institute classes), they are growing professionally at their institutions

    • Of the 45 Fellows who have completed the program, 
      • 16 have made a total of 31 presentations at international meetings; 
      • six have produced 15 peer-reviewed publications; and 
      • 13 grants and 15 awards in medical education have been obtained. 
      • Two Fellows have obtained an advanced education degree, and 
    • 14 have received an academic or administrative promotion to associate or full professor, department chair, sub-dean or dean.


Institute의 또 다른 주요 목표는 지역 수준, 국제적 수준에서 의학교육자들의 네트워크를 구축하는 것이었다.

Another major goal of the Institute is to foster development of close regional and international networks of medical educators—a cohesive international community of medical education practice. Analysis of their networks prior to the Institute has shown that the classes of 2001 to 2004 had professional networks that were initially small in number, dense (most members of their networks knew each other) and near by geographically. After the Institute, the Fellows’ professional networks had become larger, less dense and more diverse geographically.



Future plans, implications for slowing the brain drain


Our experience emphasizes that development of an international program with high-quality regional medical educational leadership institutes must take place slowly and deliberately, and be adaptable to emerging opportunities (Baker, 2000; Buchanan & Booker, 2004). Starting with an existing faculty development program, the lead time for development of a new regional institute is approximately 1–2 years. Evaluation data from the first regional institutes will need to be collected for several years before meaningful inferences can be made and used for improved development, implementation, model distribution and evaluation of other regional institutes. We anticipate that several more regional institutes and initiatives may be developed each year.


As regional institutes become stronger, we anticipate a shift in the emphasis of the FAIMER Institute. The program in the US may become more of a faculty-development leadership institute, emphasizing the skills necessary to design and manage faculty development programs, and regional institutes in particular. The central program may increasingly facilitate collaborative scholarly endeavors with Fellows around the world, using the extensive FAIMER research expertise for research design, data collection and analysis.


The field of medical education in developing countries will mature as a critical mass of skilled, internationally recognized medical educators evolves through initiatives such as FAIMER's faculty-development opportunities and facilitation of scholarly output. Increased feasibility and attractiveness of developing as a medical educator in one's home country may help slow the medical faculty brain drain.







 2006 Nov;28(7):631-4.

Slowing the brain drain: FAIMER education programs.

Abstract

Migration of physicians has produced serious shortages in many developing countries. The Foundation for Advancement of International Medical Education and Research (FAIMER) is attempting to show this international brain drain through creation of faculty development programs for medical school faculty from developing countries in order to strengthen medical education and help build a sustainable discipline of medical education. The goals of these programs are to allow Fellows to acquire basic skills in medical education, skills in leadership and management, and build a strong community of practice. Acquisition of these skills will improve medical education in their home country, stimulate growth of the field of medical education, and improve opportunities for professional advancement. Three programs currently exist: the FAIMER Institute, a two year fellowship with residential and distance learning components; International Fellowships in Medical Education, which funds selected Institute alumni to obtain masters degrees in medical education; and FAIMER regional institutes, which use the principles and structure embedded in the FAIMER Institute to build faculty development programs overseas. Evaluation of FAIMER programs indicates approximately one-third of Fellows have been promoted, and that a community of medical educators is being created in many developing countries which may promote retention of these physicians.

PMID:

 

17594555

 

[PubMed - indexed for MEDLINE]


Dropout Rates in Medical Students at One School Before and After the Installation of Admission Tests in Austria

Gilbert Reibnegger, DSc, Hans-Christian Caluba, Daniel Ithaler, Simone Manhal, Heide Maria Neges, and Josef Smolle, MD





2002-2003학년도에 오스트리아의 의학교육에는 근본적 변화가 생겼다. 전통적인, 학문 중심의 교육 프로그램이 근대적인(modern), 주제별(theme-based), 학위수여(diploma-granting) 교육과정으로 변한 것이다. 오스트리아에 있는 모든 세 개의 공립 의과대학이 이 변화를 수용했으나, 각각의 대학은 세부적인 사항에 대해서는 학교별 강점과 선호에 따라 자율적으로 조정하였다.

In academic year 2002–2003, medical education in Austria changed in a fundamental way. The traditional, discipline-oriented study program was transformed into a modern, theme-based, diploma-granting curriculum with a timely, module-track structure. Although all three public medical universities in Austria (Medical University of Vienna, Innsbruck Medical University, and Medical University of Graz) adopted this reform in general, each university was free in establishing the details of its curriculum according to its specific strengths and preferences.



Background

Graz의과대학 교육과정

The Medical University of Graz curriculum


Graz의과대학의 교육과정은 처음부터 전임상 주제와 임상 주제를 통합하는 형태였으며, 조기에 환자 경험을 쌓는 것은 사회적, 의사소통 능력 뿐만 아니라 신체검진 능력 향상에도 도움이 된다. 또한 과학적 연구에 대한 교육도 강화했으며, 새롭게 설계된 'clinical year'가 역시 교육과정의 특징이다.

The reformed curriculum at the Medical University of Graz 1 integrates preclinical and clinical topics from the beginning. Early patient contact strongly enhances training in physical examination skills as well as social and communication skills. In addition, better education in scientific research matters and a newly designed “clinical year” are the hallmarks of the new program. The curriculum is designed to be completed in six years.


처음의 두 학기는 "첫 부분"으로서 의학 맥락 속에서 기초과학을 주로 배우게 된다. "두 번째 부분"은 2학년부터 5학년까지로, 의학지식의 기초, 정상과 병리상태, 형태학, 다양한 의학/임상 학문 등등을 배우게 된다. 첫 번재와 두 번째 부분은 주제별로 5주간 진행되는 형태이다. 30개 모듈 중에서 25개 모듈은 의무이며, 5개 모듈은 선택할 수 있다.

The initial two study semesters, the “first part of study,” are dominated by the basics of natural sciences in a medical context. The “second part of study,” years 2 through 5, is devoted to the fundamentals of medical knowledge, including normal as well as pathological function and morphology and the various medical and clinical disciplines. The first and second parts of study are organized in theme-centered modules lasting five weeks each. The modules are accompanied by vertical “tracks.” In tracks, specific knowledge and skills are taught during consecutive study years. Students choose 5 out of the required 30 modules from a broad offering of elective modules; 25 modules are obligatory for all students.


6학년에는 학생들은 다양한 임상 현장에서 임상현장의 일상에 참여하게 되며, 전문적인 임상 교사(expert clinical teacher)에 의해서 관리감독을 받게 된다.  또한 6학년 기간에 5주는 general practitioner의 office에서 보내게 된다.

In year 6, students participate in the daily clinical routine at different training sites and are constantly guided and supervised by expert clinical teachers. Additionally, during the course of year 6, students also spend five weeks in a general practitioner's office.


 

오스트리아의 의과대학 입학

Medical school admissions in Austria


일반적으로 오스트리아 대학은 'open admission'을 따라왔다. 즉, 고등학교를 성공적으로 마친 학생은 누구나 자신이 원하는 어떤 대학에든 입학할 수 있다는 것이다. 그러나 의과대학에 있어서 이러한 '개방입학(open admission)'은 상당히 만족스럽지 못한 결과를 가져왔다. 예컨대, Graz의과대학의 경우 의과대학 신입생은 600~800명으로 매년 다르며, 이 숫자는 교수 뿐만 아니라 시설 측면에서 학교의 수용능력을 넘어서는 것이다. 따라서 학습 환경이 좋지 못하고, 의욕이 꺾인 학생과 교수들은 소규모 학습 따위는 거의 하지 않으며 대부분의 수업이 대형 강의로 진행된다. Bedside teaching도 거의 없다. 학생들은 의과대학이 6년제 교육과정임에도 평균적으로 50%(3년) 이상을 추가적으로 학교를 다니고 있으며, 약 절반의 학생은 졸업하기 전에 탈락(dropped out) 한다.

In Austria, open admission to university studies has been the rule: Everyone successfully finishing secondary school education is generally entitled to be admitted to whatever university study she or he wants. In medicine, open admission led to particularly unsatisfactory consequences. For example, at the Medical University of Graz, the average number of new medical students varied between 600 and 800 per year, substantially exceeding capacities in terms of staff as well as infrastructure. Thus, study conditions were poor. Frustrated students and faculty made do with little or no small-group lecturing, a predominance of mass lectures, and little bedside teaching, among other limitations. On average, students exceeded the scheduled study time of six years by 50% or more, and approximately half of the students dropped out before reaching graduation.


오스트리아 의과대학은 또한 오스트리아 외 국가에서도 학생을 받아왔는데, 역사적으로 오스트리아의 대학에 입학하는 다른나라의 학생들(EU 국가 포함)은 자신의 국가에서도 동등하게 대학에 입학하였다는 것을 입증하여야 한다. 그러나 유럽법(European law)에 따르면 EU국가의 모든 시민들은 오스트리아 대학에 지원할 때 오스트리아 국민과 동등한 대우를 받아야 하고, 2005년 7월 European court는 오스트리아의 외국 학생에 대한 정책이 위법이라는 판결을 내렸다. 

Austrian medical universities also admitted students from outside Austria. Historically, students from other countries—including member states of the European Union (EU)—were admitted to an Austrian university only after they proved they had also been admitted to the same course of study in their country of origin. According to European law, however, citizens from all EU member states must be treated in the same way as Austrians when applying to Austrian universities. In July 2005, the European Court ruled that Austria's policy of foreign student admission to university studies violated European law.2 


이러한 결정은 의과대학에 특히 결정적이었다. 독일은 오스트리아의 인접국이면서, 오스트리아와 같은 언어를 사용하는데, 독일에서는 30000명의 의과대학 지원자 중 8000명~10000명만 의과대학에 입학할 수 있었던 것이다. European Court의 판결 이후 세 개의 오스트리아 의과대학이 독일 학생들로 꽉꽉 찰 것이라는 우려가 상당했다. 이에 대한 대책으로서 오스트리아 법이 즉각적으로 개정되었는데, 대부분의 대학 입학에 대해서는 여전히 개방입학(open admission)으로 남겨놓았지만, 일부 학과에 대해서는 입학 시험을 도입하는 것으로 바뀌었고, 이러한 학과에는 의학과 치의학 학위 프로그램이 포함되었다. 또한 European Commission은 2007년부터 5년간 오스트리아로 하여금 학생의 정원을 통제할 수 있도록 하였으며, 대부분의 의과대학 정원은 오스트리아 국민에게 가도록 하였다. 전체 정원중 75%는 오스트리아 자국민에게 할당되었으며, 20%는 다른 EU국가, 5%는 그 외 다른 국가에게 분배되었다.

This decision was particularly important for medical universities because of circumstances in Austria's neighboring country, Germany, which shares the same language as Austria. In Germany, only 8,000 to 10,000 of the approximately 30,000 applicants for the study of medicine are admitted each year. Therefore, after the court's decision, it was feared that the three Austrian medical universities would be overwhelmed by German students. To avoid this, Austrian law was changed immediately: While admission to most university study programs remained open for all applicants having completed secondary education, admission tests were introduced to regulate access for selected studies. Among the regulated studies were the diploma programs in human medicine and dentistry. Additionally, the European Commission issued a five-year moratorium in 2007,3 entitling Austria to regulate quotas of students until 2012 to ensure that the majority of openings are reserved for Austrian citizens. Seventy-five percent of openings are reserved for applicants who completed their secondary education at an Austrian school, 20% for citizens from other EU states, and 5% for applicants of other nationalities.


 

Graz의과대학의 선발

Medical University of Graz admissions

 

2005년, Graz의과대학은 난관에 봉착했는데, 이 전 년도의 개방입학에서 지나치게 많은 학생들이 입학한 것이다. 또한 2002-2003학년도에 도입된 새로운 교육과정은 이 전 교육과정에 비해서 더 많은 자원이 투입되어야 했다. 이러한 상황에서 '첫 파트'를 성공적으로 이수한 학생들도 즉각적으로 '두 번째 파트'로 진학하지 못하는 문제가 생겼다.

In 2005, the Medical University of Graz faced an unfortunate state of affairs. Because of the open admission policy of previous years, there was an inordinate number of students enrolled in the diploma of human medicine program. Further, the new curriculum implemented in 2002–2003 required significantly more resources than the previous program. Under these circumstances, students who had successfully completed the first part of study could not immediately proceed with the second part because of a lack of resources.


 

이러한 상황을 해결하기 위해서, 의과대학에서는 두 가지 당시의 법적 상황을 활용하여서 새롭게 입학하는 학생의 숫자를 조절하였다. 이에 따라 2005-2006학년도에는 107명의 학생만이 새롭게 입학하였고, 그 다음 해에는 154명, 그 다음 해에는 282명으로 서서히 그 수가 증가하였다. 이러한 방식으로 Graz의과대학은 성공적으로 학생이 누적되는 문제를 해결하였다. 2008-2009학년도 이후에는 약 350명의 학생이 입학하고 있으며, 이것이 거의 상한선에 해당한다. 

To resolve this situation, the university used the new legal situation to manage the numbers of new students entering the university very efficiently. Thus, in academic year 2005–2006, only 107 new students were admitted. In the two following years, the numbers were raised incrementally (154 in 2006–2007, and 282 in 2007–2008). By this measure, we successfully eliminated the backlog of students waiting to continue their studies. Since 2008–2009, 340 to 350 students have been admitted per year, representing the upper limit of capacity. This upper limit was consensually defined with the Federal Ministry of Science and Research on the basis of previous experience.



입학 과정을 개선하기 위해서 두 가지 과정이 진행되었는데, 첫 번째로 2005-2006학년도에 1000명이 넘는 모든 지원자를 모두 임시합격시켜서 첫 학기를 이수하게 하였으며, 이 때애는 거의 인터넷을 활용한 원거리학습을 사용하였다. 첫 학기의 세 개 모듈은 모두 전자문서형태로 변환되었고, 'Graz의과대학가상캠퍼스'를 통해서만 제공되었다. 이는 종합적, 웹기반 학습 플랫폼으로 Graz의과대학에서 이전에 개발된 것이다. 2006년 1월에 임시 합격한 모든 지원자는 2일간의 선발 절차를 통과해야 하는데, 제1일에는 세 모듈에 대한 다지선다형 필기시험을 치르며, 제2일이에는 추가적은 다지선다형 시험을 통해서 생물, 화학, 물리, 수학에 대한 고등학교 수준의 지식을 평가한다. 최종 합격은 성적순으로 107명을 선발하며, 이 학생들이 최종입학하여 향후 의과대학 수업을 받게 된다. 다른 모든 학생들은 탈락된다.

Two different procedures were applied in our efforts to reform the admission process. First, in academic year 2005–2006, all applicants (more than 1,000) were preliminarily accepted for an initial semester, which entailed exclusively distance learning via the Internet. The contents of the three modules of the first study semester were transformed into electronic documents and were offered to students online by means of the Virtual Medical Campus Graz. This is a comprehensive, Web-based learning platform which had been developed previously at the Medical University of Graz 4–6 to support teaching and learning. In January 2006, all preliminarily accepted students had to pass a two-day selection procedure. On day 1, there was a written assessment in multiple-choice (MC) format based on the students' knowledge of the three modules. On day 2, the students took an additional MC test further assessing their knowledge of biology, chemistry, physics, and mathematics on the secondary school level. The available admission openings were awarded to the 107 applicants ranking highest after both assessments. These applicants then were fully admitted to further study. All other applicants were excluded from continuing their study.


 

두 번째 단계는 2006-2007학년도에 도입된 것으로서, 지금까지도 계속되고 있는데, Graz의과대학은 지원자의 수행능력을 기반으로 한 선발 과정을 치른다. 이 시험은 앞에서 제2일에 시행한 시험을 기반으로 만들어졌으며, 주로 고등학교 수준의 생물, 화학, 물리, 수학 시험을 보고, 과학교과에 대한 지원자의 이해능력을 평가한다. 자연과학 부분에 초점을 둔 이러한 시험을 도입한 주 근거는 오스트리아 고등학교 교육과정이 워낙 다양해서 의과대학에 입학한 많은 학생이 고전한다는 오래된 관찰 결과에 기반한 것이다. 

The second process was implemented for academic year 2006–2007, and it continues today. The Medical University of Graz employs a selection procedure based on an applicant's performance on a required MC test prior to admission. This test was built on the basis of the test used on day 2 of the previous admission test. It is based mainly on secondary-school-level knowledge of biology, chemistry, physics, and mathematics and further includes assessment of the applicant's comprehension of scientific texts. A major rationale for using an admission test focusing mainly on the natural sciences was the long-standing observation that, because of strong heterogeneities in Austrian secondary school education, many medical students faced massive difficulties—and hence, the largest risk to fail and to drop out of study—during the initial study semesters, which are dominated by these scientific disciplines.



경험이 풍부한 대학 교수가 시험을 출제하며, 시험은 매년 7월 치러지고 성적이 좋은 지원자만이 의과대학에 입학할 수 있다. 현재, Graz에서 사용하고 있는 입학 시험은 일부 독일 의과대학에서 사용하는 입학 과정과 유사하며, 이들 대학과 향후 더 협력할 계획을 가지고 있다.

Experienced university faculty produce the test items. The admission test takes place in July each year during the holiday season of schools and universities. Those applicants who rank best on the admission test are admitted to study. Presently, the admission test is used only at the Medical University of Graz, but there are similar admission procedures at some German medical faculties (e.g., University Medical Center Hamburg–Eppendorf), and we are considering cooperating more closely with these faculties in the future.


 

Studying the effects

 

우리가 기대하는 것은 학생들의 수학기간(6년 교육과정임에도 9년간 공부하는)의 단축, 그리고 탈락률(50%이상)이 감소하는 두 가지 이다.

In summary, starting with academic year 2005–2006, a fundamental change in Austria's admission practice for medical studies caused leaders at the Medical University of Graz to implement sweeping reforms to their own admissions practices. Not only was the threat of becoming overwhelmed by German students removed, the university was for the first time able to adjust the number of fresh medical students according to the capacities available. Two major research hypotheses—and indeed hopes—accompanied the introduction of selective admission procedures: We expected that students' overlong study times (approximately nine years instead of six years as scheduled) as well as the absurdly high study dropout rates (50% or more) would be efficiently reduced.


We addressed the first of these research questions, namely, the effect of the change in admission practice on study progress rates, in a previous analysis.7 In the present investigation, we investigate the second important question mentioned above: Is there a measurable effect on dropout rate of the change in admission practice from open admission to active selection of students? How large is the putative effect? Do demographic variables such as students' nationality, age, and sex significantly modulate the putative effect?



Method

 

Participants

We included in the study all new students routinely enrolled in the new diploma human medicine program during the academic years 2002–2003 to 2008–2009. We excluded from the investigation students being admitted by any other route (e.g., students with prior credits from medical studies at the Medical University of Graz or elsewhere).


총 2860명의 학생

In total, we included 2,860 students for statistical analyses. Of these, 1,971 (68.9%) were openly admitted during academic years 2002–2003 to 2004–2005; 889 (31.1%) were admitted after passing an admission procedure during years 2005–2006 to 2008–2009.


코호트별로 observation period가 다름

Data on study progress were accumulated from academic year 2002–2003 until the end of the winter semester in academic year 2009–2010 (February 28, 2010). Thus, the observation period varies among cohorts from the investigated academic years. Whereas students who were enrolled in 2002 and 2003 were observed for more than six years and thus were able to reach graduation during the observation time, the observation period for students who were enrolled in 2004 and later was shorter than the scheduled six years of the curriculum.


남성 여성, 연령. 연령은 3분위수를 이용하여 20.89세를 기준으로 이분화함. 1~3분위는 매우 숫자가 가까웠음. 그래서 나머지를 '나이든' 그룹으로 묶음.

The study included 1,230 men (43.0%) and 1,630 (57.0%) women. Age range was from 17.51 to 50.03 years (median: 19.69 years; first quartile: 18.92 years; third quartile: 20.89 years). As in our previous investigation,7 for subsequent analysis we arbitrarily dichotomized the variable “age at study entry” at the third quartile of 20.89 years. There was no other motivation for the dichotomization just at this age other than to compare younger and older participants; because the first, second, and third quartile are very close, the third was taken to ensure a reasonable number of participants in the “older” group. Finally, 2,481 of the students (86.7%) were Austrians, 226 (7.9%) were Germans, and 153 (5.4%) came from other nations.


학생을 선별할 수 없도록 데이터를 수집하였음. 

We gathered the deidentified data from information that is routinely collected about medical students' admission, dropout, and graduation dates and examination history, as required by the Austrian Federal Ministry of Science and Research. Because the data were anonymous and no data beyond those required by law were collected for this study, the Medical University of Graz's ethical approval committee did not require approval for this study.


 

통계

Statistical methods

탈락하는 학생에 대해서 학생이 탈락하고 말고 뿐만 아니라, 어느 단계에서 탈락하느냐도 중요함. 

Phenomena such as students prematurely dropping out of a program are intrinsically time-dependent: Besides the question of whether or not a student drops out, it also matters when in the course of study this event occurs. Proper analysis of dropout, therefore, must include the time elapsing between a defined starting event (in our analysis, this is the date of enrollment) and the terminating event under consideration (the date of dropout) as a central variable. 


ANOVA나 회귀분석 같은 방법은 적절하지 않음. 학생마다 모두 학습이 달라서 모든 학생이 탈락하거나 모든 학생이 졸업할 때까지 기다릴 수 없음. 

Application of ordinary statistical methods, such as analyses of variance or regression techniques, frequently are not suitable in investigations of this type. First, study progress of participants may vary considerably, and one might be interested in drawing sound conclusions without waiting until all participants have either dropped out or reached graduation. Under reasonable circumstances, only a fraction of participants will experience the terminating event “dropout” within a given observation time, and—at least in principle—other participants may get lost from the observation for reasons other than dropout (e.g., graduation). This latter phenomenon is called censoring. Participants experiencing the defined termination event during the observation period carry full information for statistical analysis (“they have experienced the terminating event after a well-defined time interval”). Participants who do not drop out of study during the observation period nevertheless contribute important information, at least for the time period under observation (“they have not experienced the terminating event during a well-defined time interval”) but not thereafter.


이러한 경우에 의학에서는 생존분석을 하게 됨. 입학 전형 또는 인구학적 특성에 따라서 탈락율 차이를 분석함.

In medicine, we meet situations of this type very commonly in survival studies. In these cases, the starting point very frequently is the date of diagnosis of, for example, a malignant tumor, and the terminating event might be the date of detection of tumor recurrence or metastasis or even death. Consequently, we analyzed the effects of open admission versus active admission procedure as well as of some selected demographic variables on dropout rates by statistical methods from the field of survival analysis.8


 

Here, we distinguish between nonparametric, semiparametric, and parametric methods. The product-limit approach by Kaplan and Meier 9 does not make any assumption concerning the underlying hazard function (“baseline hazard”) for the terminating event under scrutiny but estimates the cumulative probabilities of “survival” (for our purpose, this corresponds to “retention in study”) merely from the empirical data at hand. Thus, it is a nonparametric method. The proportional hazards method by Cox 10 also does not make any assumption about the baseline hazard; the effect of covariates, however, is modeled by a parameterized analytic expression. The model parameters are estimated from the data and allow, in a multivariate fashion, quantification of the relative predictive strengths of the variables included with regard to the terminating event. The Cox method is thus a semiempiric one. Finally, there are a host of parametric models which provide explicit mathematical models for the baseline hazard as well as covariate effects. These models assume one of several possible distribution models for the baseline hazard (e.g., exponential distribution, Weibull distribution, Gompertz distribution, and others) with adjustable parameters. If appropriate, such models allow the estimation of cumulative probabilities as a function of time by means of an explicit analytic expression.


 

We used the nonparametric product limit technique by Kaplan and Meier to compute the cumulative probabilities for retention in the course of study for student categories defined on the basis of several variables: mode of admission (open admission versus selection), sex, age, and nationality. Such cumulative probabilities are usually represented graphically by typical step functions decreasing from 1.0 to smaller values, as observation time progresses. We tested differences of cumulative retention probabilities among different categories by the generalized likelihood ratio method (Breslow [chi]2 statistic).11 To visualize the time-dependent risk of experiencing dropout for students in defined categories, we computed smoothed hazard functions for dropout according to Muller and Wang.12 These smoothed hazard functions give the instantaneous probabilities that a participant will experience a terminating event at time “t.” Roughly, they represent the negative first derivative with respect to time of the cumulative retention probabilities. We employed the semiparametric proportional hazards model by Cox in order to study the combined effects of potential predictor variables in a multivariate manner and to identify the relative strength of each individual predictor variable in the context of all other variables.



All statistical evaluations, including basic statistics for comparison of mean values and frequencies among different groups of students, were done using commercially available software (Stata Statistical Software: Release 11; StataCorp, 2009, College Station, Texas).










Results

Cumulative probability of dropout was significantly reduced in students selected by active admission procedure versus those admitted openly (P < .0001). Relative hazard ratio of selected versus openly admitted students was only 0.145 (95% CI, 0.106–0.198). 


Among openly admitted students, but not for selected ones, the cumulative probabilities for dropout were higher for females (P < .0001) and for older students (P < .0001). Generally, dropout hazard is highest during the second year of study.



Conclusions

The introduction of admission testing significantly decreased the cumulative probability for dropout. In openly admitted students a significantly higher risk for dropout was found in female students and in older students, whereas no such effects can be detected after admission testing. Future research should focus on the sex dependence, with the aim of improving success rates among female applicants on the admission tests





 2011 Aug;86(8):1040-8. doi: 10.1097/ACM.0b013e3182223a1b.

Dropout rates in medical students at one school before and after the installation of admission tests in Austria.

Abstract

PURPOSE:

Admission to medical studies in Austria since academic year 2005-2006 has been regulated by admission tests. At the Medical University of Graz, an admission test focusing on secondary-school-level knowledge in natural sciences has been used for this purpose. The impact of this important change on dropout rates of female versus male students and older versus younger students is reported.

METHOD:

All 2,860 students admitted to the human medicine diploma program at the Medical University of Graz from academic years 2002-2003 to 2008-2009 were included. Nonparametric and semiparametric survival analysis techniques were employed to compare cumulative probability of dropout between demographic groups.

RESULTS:

Cumulative probability of dropout was significantly reduced in students selected by active admission procedure versus those admitted openly (P < .0001). Relative hazard ratio of selected versus openly admitted students was only 0.145 (95% CI, 0.106-0.198). Among openly admitted students, but not for selected ones, the cumulative probabilities for dropout were higher for females (P < .0001) and for older students (P < .0001). Generally, dropout hazard is highest during the second year of study.

CONCLUSIONS:

The introduction of admission testing significantly decreased the cumulative probability for dropout. In openly admitted students a significantly higher risk for dropout was found in female students and in older students, whereas no such effects can be detected after admission testing. Future research should focus on the sex dependence, with the aim of improving success rates among female applicants on the admission tests.

PMID:

 

21694561

 

[PubMed - indexed for MEDLINE]







An analysis of the German university admissions system

Alexander Westkamp






독일 법에 따르면 Arbitur (secondary school을 성공적으로 마침)을 획득한 학생이라면 누구나, 어떤 학과든, 어떤 공립대학에서 수학할 자격이 주어진다. 

According to German legislation, every student who obtains the Abitur (i.e., successfully finishes secondary school) or some equivalent qualification is entitled to study any subject at any public university. Given capacity constraints at educational institutions and the ensuing need to reject some applicants, this principle has long been reinterpreted as meaning that everyone should have a chance of being admitted into the program of his or her choice. In order to implement this requirement, places in those fields of study that are most prone to overdemand have been allocated by a centralized nationwide assignment procedure for over 25 years. 


In the first part of this paper, I analyze the most recent version of this procedure that is currently used to allocate places for medicine and three specialities (dentistry, pharmacy, and veterinary medicine). In the winter term 2010/2011, more than 56,000 students applied for one of the less than 13,000 places available in these four subjects, meaning that ultimately three in four applicants had to be rejected. What sets this part of my study apart from previous investigations of real-life centralized clearinghouses is the sequential nature of the German admissions procedure: In the first step, the well-known Boston mechanism is used to allocate up to 40 % of the total capacity of each university among special applicant groups, consisting of applicants who have either obtained excellent school grades or have had to wait a long time since finishing school


About one month later, all remaining places—this includes in particular all places that could have been but were not allocated to special student groups—are assigned among remaining applicants according to criteria chosen by the universities using the college (university) proposing deferred acceptance algorithm (CDA). Applicants belonging to special student groups, who were not assigned one of the seats initially reserved for them, have another chance of obtaining a seat in this part of the procedure. 





Westkamp, A. (2013). An analysis of the German university admissions system.Economic Theory53(3), 561-589.


Abstract This paper analyzes the sequential admissions procedure for medical subjects at public universities in Germany. Complete information equilibrium outcomes are shown to be characterized by a stability condition that is adapted to the institutional constraints of the German system. I introduce matching problems with complex constraints and the notion of procedural stability. Two simple assumptions guarantee existence of a student optimal procedurally stable matching mechanism that is strategyproof for students. In the context of the German admissions problem, this mechanism weakly Pareto dominates all equilibrium outcomes of the currently employed procedure. Applications to school choice with affirmative action are also discussed.


Keywords University admissions · Matching · Stability · Strategyproofness · Complex constraints


Undergraduate medical education in Germany

Jean-François Chenot1

1 Department of General Practice, University of Göttingen, Germany



Background


독일의 첫 의학 강의는 1388년 하이델버그에서 있었다. 가장 최근에 설립된 medical faculty 는 Witten-Herdecke 에 1992년 설립되었다. 독일의 의학교육은 한 때에는 미국 의학교육의 롤모델로 일컬어지기도 했다. 그러나 최근 독일의 의학교육은 미국, 캐나다, 영국이나 네덜란드와 같은 다른 유럽국가들이 어떻게 하는지를 살펴보고 있다.

In Germany, lectures in medicine were first given in 1388 in Heidelberg. The latest medical faculty was founded in Witten-Herdecke in 1992. Medical education in this country was once praised as a role model e.g. for American medical education by Abraham Flexner [1]. Nowadays, however, the German medical faculties are looking towards the United States [2], Canada, and other European countries such as the United Kingdom and the Netherlands for good examples to follow.


독일에는 약 8만명의 의과대학생이 있고, 36개의 의과대학(medical faculties)가 있다. 매년 1만명의 새로운 학생들의 의학의 길로 들어서며, 약 6000명의 학생이 매년 졸업한다. 의과대학의 지역별 분포는 인구밀도보다는 역사적 발전배경에 따른 것이다.

Germany has about 80,000 medical students studying in 36 medical faculties (Table 1 (Tab. 1), list with URLs see Attachment 1) [3]. Each year 10,000 new students start medical education and about 6000 students graduate every year. Geographic distribution of medical faculties in Germany reflects historic developments rather than population density (Figure 1 (Fig. 1)).


약 180,000유로(한화 약 2억5천만원)정도가 한 명의 의과대학생을 길러내는데 들어가며, 이는 영국의 260,000유로와 비교되곤 한다. 그러나 한 의과대학을 제외하고는 모두 주립대학이며, 최근까지 학부의학교육은 무상으로 제공되었다. 최근에서야 일부 주에서 학기당 500유로 정도의 등록금을 학생들에게 부담시키고 있으며, 미국에 비하면 매우 낮은 편이다. 학자금 대출도 가능하다.

It is estimated that 180,000 Euros are required to cover the cost of teaching for each graduating medical student in Germany [3]. This compares to 260,000 Euros in the United Kingdom [4]. All but one medical faculty (Witten-Herdecke) are state universities, and until recently higher (undergraduate) education was free – now a few states charge up to 500,- € tuition per semester which is low in comparison to fees required for example in the United States [5]. Grants and student loans are available [6].


이러한 배경을 놓고 볼 때, 이 논문의 목적은 "Regulation of the Licensing of Doctors"가 새롭게 도입됨에 따라 해외 독자들에게 독일 학부 의학교육의 구조와 교육과정, 조직에 대해 설명하고자 하는 것이다. 

Given this background, the aim of this article is to provide international readers with an overview of the organisation, structure and curriculum of undergraduate medical education in Germany following the introduction of the new "Regulation of the Licensing of Doctors". This narrative review is based on data available from official organisations, relevant German medical journals generally not listed in Medline or EMBASE, and on personal experience. It is therefore likely to serve as a reference for reports of research in medical education in Germany and could also help international medical staff seeking to assess medical students taught in Germany who are applying for elective clerkships abroad.






Structure and curriculum of medical education

The new regulation of the licensing of doctors


독일 의학교육은 2003년 도입된 Regulation of the Licensing of Doctors의 이후에 국제 학술지에 소개된 바가 없다. 이 개혁은 독일의 정부기관, 비정부기관 등에서 독일의 의학교육이 EU의 요구조건을 만족시키지 못하고 있다는 주장이 제기됨에 따라서 도입되었다. 독일에서 의학교육에 대한 관심은 네덜란드나 영국에 비해서는 낮은 편이지만 새로운 AppOA가 도입된 이후에 모멘텀을 얻고 있으며 교육과정에도 상당한 변화가 생겼다. 주요 변화는 다음과 같다.

German Medical Education has not been described in international journals since the new "Regulation of the Licensing of Doctors" [Approbationsordnung für Ärzte (AppOÄ)], which came into effect in 2003 [7], [8], [9]. This structural reform became necessary when reports from governmental and non-governmental institutions concluded that medical education in Germany did not meet actual requirements in medical care or stipulations from the European Union [10], [11]. While interest in medical education in Germany was relatively low compared to e.g. The Netherlands or the United Kingdom, it has now gained momentum with the new AppOÄ, which required substantial changes in the curriculum. The main changes are [8]:


    • Incorporation of the changed requirements in medical care
    • Linkage of theoretical and clinical instruction
    • Extension of interdisciplinary and topic-related instruction
    • Improvement of bedside training, reduction of lectures
    • Reform of examinations
    • Strengthening of General Practice
    • Evaluation of teaching
    • Improving pain management and palliative care


의과대학에 중요한 문제는 아니었을지 몰라도, 의과대학생들에게 있어서 가장 와닿는 변화는, 완전면허(full license)를 받기 위해 필요했던 18개월간의 인턴십(AiP)가 폐지된 것이다. 이 기간의 임금은 상당히 낮은 편이었다.

Although of limited importance to medical faculties, for graduating medical students the most tangible change represented the abolishment of the lowly paid 18-month internship [Arzt im Praktikum (AiP)] before obtaining the full license to practise medicine [12].


이 다음부터는 의과대학 교육과정에 대해 다루고자 한다.

In the following description of the medical curriculum and in the discussion, the main goals of the new AppOÄ will be referred to.



Admission criteria for medical students


매우 소수의 예외를 제외하고 독일고등교육적성인증(General Certificate of Aptitude for Higher Education, Abitur)은 대학의 고등교육을 받기 위해서 반드시 필요하다. 12~13년간 학교를 다녀야 하며, 약 39%의 학생이 Abitur를 획득한다. Abitur는 미국의 '고등학교 졸업장'에 해당하는 것은 아니며, 그보다는 US colleges의 학위와 비슷한 것이다. EU내에서의 Secondary school diploma는 상호 인정을 받을 수 있으나 EU 외 지역에서 diploma를 받은 경우에는 이것이 서로 동등한 것임을 증명하는 인증을 획득해야 한다. 일부 국가에서 주되게 활용되고 있는 의학에 있어서의 undergraduate education(prepatory class, 우리나라의 의예과 개념인 듯)은 독일에서는 존재하지 않으며, 따라서 엄밀히 말하면 undergraduate 또는 graduate education이라는 개념은 옳지 않다.

With few exceptions, the General Certificate of Aptitude for Higher Education [Abitur] is a prerequisite for admission to higher education in a university. It usually requires 12 or 13 years of schooling. Roughly 39% of all school children will obtain the Abitur [13]. The Abitur cannot be compared to a high school diploma in the United States; it is closer to the associate degree of US colleges. Secondary school diplomas obtained inside the European Union are mutually recognised; however students with diplomas obtained outside the European Union have to apply for a certificate of equivalence. Undergraduate education e.g. preparatory classes for medical school, prevalent in some countries, do not exist in Germany. Therefore, the term undergraduate or graduate education does not apply in the strict sense.



독일에서 의과대학 신입생의 평균 연령은 21.4세이며, 여기에는 몇 가지 이유가 있는데 독일 남성들에게는 9개월간의 군복무 의무가 부과된다.(양심적 병역거부자(conscientious objectors)들은 대체민간봉사(alternative civilian service)한다.) 다른 분야에서의 professional training을 받는 경우 또는 waiting time으로 인한 이유도 있다. 공식적 규제는 없으나 40세가 의과대학 입학의 상한선으로 간주되고 있으며, 다른 많은 국가와 마찬가지로 의과대학의 여학생은 빠르게 증가하여 이제는 남학생보다 그 수가 많아졌다. 

In Germany, the average age of medical students is 21.4 years when they start medical school [14]. There are several reasons for this. Germany still has mandatory service of nine months for men either in the military or an alternative civilian service [Zivildienst] for conscientious objectors. Additionally due to waiting time or professional training in other areas, a significant proportion of students are older. Although there is no formal regulation, an age of 40 years is considered the upper limit for entering medical school. Similar to many other countries, the number of women studying medicine has increased steadily and is now exceeding the proportion of male students [15]. This however is not yet reflected in higher academic ranks.


Selection of medical students


의과대학에 지원하는 지원자의 수는 정원보다 훨씬 많아 입학 정원이 제한되어 있다. 평균적으로 4~5:1정도의 경쟁률이 되나, 대학마다 차이가 크다. 독일에서 의과대학 지원과 선발은 ZVS라는 중앙 국가 기관에 의해서 운영된다. 입학 기준으로는 Abitur grade(미국의 GPA에 해당)와 대기시간(waiting time)이 있다. Abitur는 교육과정을 성공적으로 마칠 것인가에 대한 가장 좋은 예측인자이다. 각 학생은 한 번에 6개까지 의과대학에 1순위부터 6순위까지 지원을 할 수 있으며, 대부분의 의과대학 학생은 이러한 절차를 거쳐서 입학하게 되나, 일부 해외 학생이나 군(military)를 위한 정원이 있다.

The number of applicants to medical schools largely exceeds the number of available places; therefore admission is subject to restrictions [numerus clausus]. On average four to five prospective students apply for each place, however there are large differences between the faculties. In Germany, application to medical schools is administered by a federal organisation, the Central Office for the Allocation of Places in Higher Education [Zentralstelle für die Vergabe von Studienplätzen (ZVS)] [16]. Criteria for admission are the overall Abitur grade, which is roughly comparable to the American Grade Point Average (GPA), and waiting time. The Abitur is considered the best predictor for successful completion of the curriculum [17]. Each student can rank and apply to 6 medical schools at once. The majority of medical students (80%) used to be admitted by this process and there is a quota for foreign medical students and the military.


의과대학에 의해서 자체적으로 선발되는 학생의 비율은 60%까지 증가하였다.(?). 대부분의 학생은 의과대학에 지원동기를 제출하는데, 의과대학에서는 이 지원서를 살펴본 후에 일부 학생을 대상으로 면접을 한다. 그러나 종종 이 단계는 시간이 굉장히 많이 소모되며 지원자의 수가 너무 많은 때도 있다. 따라서 의과대학에서는 교수들에게 이 과정에 참여하라고 독려하기가 쉽지 않다. 또한 미래 의사가 될 학생을 선발하는 criteria에 대한 합의가 없는 경우도 있다. 이러한 상황에서 TMS라는 국가적 의과대학입학시험은 1997년 폐지되었으나 일부 의과대학에서 다시 도입되기도 하였다. TMS는 미국의 MCAT에 비유될 수 있으며, TMS가 의무사항은 아니지만 선발 단계에서 면접대상자로 뽑힐 가능성을 높여주는 면은 있다.

The proportion of students who are selected by the medical schools themselves is supposed to increase to 60%. Usually students apply with a letter of motivation to medical schools. After screening the applications a few are invited for interview [18]. However the process is time consuming and sometimes the number of applicants is overwhelming. Therefore faculties find it difficult to motivate faculty members to participate in the selection process. There is also often no consensus on the criteria that should be used to select future doctors. Given this situation, the nationwide medical admission test [Test für Medizinische Studiengänge (TMS)], which had been abandoned in 1997, has been reintroduced by some faculties [19]. The TMS is comparable to the American Medical college admission test (MCAT) [20]. The TMS is not mandatory but allows students to improve their score and their chance of being selected to come for an interview.




Structure of the curriculum


독일에서 의학교육은 다른 많은 국가가 '연' 단위로 되어있는 것과 달리 '학기'단위 또는 일부 경우 '3분기(trimester)' 단위로 구조화되어있다. 교육과정을 마칠 때 까지는 총 6년(12학기)+3달이 걸리며 평균적으로는 6.8년정도 학교를 다닌다. 교육과정은 크게 세 섹션으로 나뉜다.

In Germany, medical education is structured, not in years like many other countries, but in semesters or in a few instances, trimesters (Hamburg, Hannover). It takes six years (12 semesters) and three months to complete the curriculum, however on average, students require 6.8 years [3]. The curriculum is divided into three sections (Table 2 (Tab. 2)):


    • Basic science (2 years)
    • Clinical science (3 years)
    • Clinical year (1 year)


대다수의 학생은 이 단계를 따르게 되며, 일부 의과대학은 실험적 교육과정을 운영하기도 한다.

The majority of medical students follow this track. Some medical faculties have chosen to offer an experimental curriculum [Modellstudiengang] which offers an alternative process to becoming a doctor (Table 1 (Tab. 1)) [21].



Basic science [Vorklinik] 

기초의학 과정의 내용과 구조는 거의 변화가 없으며, 주 과목은 해부학, 생리학, 생화학, 사회과학이다. 대부분 Pass또는 Fail로 평가한다. 기초의학과 임상의학 사이의 간극이 비판을 받고 있는데, 졸업생들은 이 기초과학 내용이 임상에서 거의 쓸모가 없다고 평가하고 있다. 따라서 기초과학을 임상적 맥락에서 교육하기 위한 노력이 지속적으로 이뤄지고 있으며, 3달간의 nursing stage가 기초의학 부분에서 의무적으로 운영되고 있다. 그러나 추가적인 준비과정을 운영하고 있는 사립 기관(private institutions)이 점차 증가하고 있으며, 이는 의사국가시험을 합격하기에 충분한 교육이 이뤄지지 못한다는 것을 의미한다.

The content and structure of the basic science section (also preclinical science) has remained largely unchanged. The main topics are anatomy, physiology, biochemistry and social sciences (Table 2 (Tab. 2)). Courses are usually not graded beyond pass or fail. The distinction between clinical and basic science has been criticised and graduate students have rated large parts of the curriculum as clinically irrelevant [22]. Therefore there are increased efforts to place basic science in a clinical context [23], [24]. A three month nursing stage is a mandatory part of the basic science section to ensure first patient contact. However private institutions are increasingly offering additional preparatory classes, which might indicate the failure of the faculties to provide the necessary skills and knowledge to pass the state medical licensing examinations.


Clinical science [Klinik] 

임상과학은 21개의 전공과목을 포함하며, 예전에는 각각의 과목을 개별적으로 가르쳤다. 그러나 이제는 여러 과목을 학제간교육모듈(interdisciplinary teaching modules)로 교육하고 있어서 "head module"에서는 귀, 코, 목, 안과 등을 같이 다룬다. 추가적으로 12개의 학제간교육모듈이 도입되었으며, 대체로 첫 해에는 임상과학의 도입부분으로 병력청취와 신체검진의 기본 기술을 익힌다. 또한 일반 병리학, 일반 미생물학, 일반 약리학, 실험의학 등을 배운다. 전통적으로 임상과학 교육과정은 환자 노출이 별로 없고 강의와 세미나로 진행되었는데, 임상경험을 강화시키기 위해서 의무적 임상실습이 내과, 일반외과, 소아과, 산부인과, 일반과(General Practice) 과목에 도입되었다. 정신과학이 대부분의 국가에서 핵심 과목으로 다뤄지는 것과 달리 독일에서는 의무가 아니다. 임상술기실습(Clinical skill lab)이 여러 대학에서 도입되었으며, 학생은 한달짜리 elective clerkship을 선택할 수 있다. 한 개의 clerkship은 외래에서 진행되어야 한다. 

The clinical science section covers 21 medical specialties as listed in Table 2 (Tab. 2). Previously each subject was taught separately. Now subjects are often taught in interdisciplinary teaching modules e.g. a “head module” combining Ear, Nose & Throat Medicine with Ophthalmology [25]. Additionally 12 new interdisciplinary teaching modules [Querschnittsbereiche] have been introduced (Table 3 (Tab. 3)). Usually the first year is dedicated to the introduction of the clinical sciences with basic skill training in history taking and physical examination, general pathology, general microbiology, general pharmacology and laboratory medicine. Traditionally the clinical science section consisted mainly of lectures and seminars with limited patient exposure. To strengthen clinical experience, mandatory clerkships [Blockpraktikum] have been introduced in Internal Medicine, General Surgery, Paediatrics, Obstetrics & Gynaecology and General Practice. It is notable that a clerkship in Psychiatry, which is considered a core subject in many countries, is not mandatory. Clinical skills labs have been newly established in most faculties [26]. Additionally students have to complete four one-month elective clerkships, traditionally called Famulatur [famulus latin: servant]. One clerkship has to be completed in the ambulatory setting. It is very popular to perform at least one elective outside Germany with a preference for English speaking countries.


Clinical year [Praktisches Jahr: PJ] 

마지막 학년은 세 개의 full-time clinical rotation으로 구성되어 있으며 각각은 4달씩 진행된다. 내과와 외과 rotation은 의무적으로 들어가야 하며, 한 개는 임상과들 중 자유롭게 고를 수 있다. 예전에는 마지막 학년은 병원을 중심으로 훈련을 받아야 했지만 새로운 AppOA에서는 외래 기반 세팅에서도 실습이 가능해졌다.

The final year is divided into three full-time clinical rotations, each lasting about 4 months (Table 2 (Tab. 2)). Rotations in Internal Medicine and Surgery are mandatory and one rotation can be freely chosen from all the clinical specialties. Previously, the final year had been restricted to hospital based training sites. The new AppOÄ made it possible for the first time to complete a clinical rotation in an ambulatory setting, e.g. in General Practice [27].


마지막 학년 내에서도 학생은 점차 더 많은 책임을 지게 되는데, 이는 서브인턴십과 비슷한 것이다. 법적인 문제들이 학생들이 직접 자신이 해볼 수 있는 임상 경험을 쌓는데 제한이 되고 있다. 혈액 채취나 IV line을 잡는 것은 대부분의 국가에서 AN에 의해서 이뤄지지만, 독일에서는 이런 일 때문에 최종학년 학생(PJler)들이 바쁘다. 일반적으로 학생들이 임상현장에서 배우는 것을 당연하게 받아들이지만, 감독과 지시의 수준은 무척 다르다. 

Students usually assume more responsibilities gradually during the final year, comparable to a sub-internship. Legal 

issues regarding delegation and liability limit students’ opportunity to gain hands on experience [28]. Hospitals often rely on the work accomplished by the final year students [PJler]. Unfortunately, taking blood samples and inserting intravenous lines, which is done by auxiliary nurses in most other countries, keeps PJ students busy [29]. It is generally taken for granted that students learn skills on the job, but the degree of supervision and instruction varies widely [30]. Multiple projects to improve the quality of teaching in the clinical year have been presented and only a few can be cited here [31], [32].


스위스에서 독일어를 사용하는 지역에서는 최종학년 학생들에게 일정부분의 보상을 지급하고, 이렇게 보상을 지급하는 것에 대한 논쟁이 있다. 의사 부족이 점차 심해지면서 일부 교육병원(teaching hospital)에서는 학생들을 졸업 후 수련과정에 유지시키기 위해 특별히 노력을 기울이고 있다.

As the German-speaking region of Switzerland offers a basic remuneration to final year students, there is a debate as to whether students should be paid. With the increasing shortage of physicians, some teaching hospitals are known to make special efforts to retain some students for postgraduate training.








Examinations

새로운 AppOA가 도입되기 전까지는 의과대학생의 학업성취도는 pass/fail로 평가되었고, 면허시험만이 점수를 주게 되어 있었다. 대학의 입장에서 새로운 regulation이 불러온 가장 큰 변화는 (1)각각의 교과목과 임상실습에 대한 grade를 매겨야 하는 것, (2)면허시험을 3단계에서 2단계로 축소시키는 것이었다. Grade는 1(excellent)에서 5(fail)까지 순위로 매겨진다.

Until the new AppOÄ, the achievements of medical students in courses and clerkships were evaluated simply with a pass or fail. Only state licensing examinations were graded. From the faculties perspective the most radical changes with the new regulations for medical education were 1. the requirement to grade each course and clerkship and 2. the reduction of the number of licensing examinations from three to two. Grades are given on an ordinal scale ranging from 1 (excellent) to 5 (fail).


대학의 책임을 강화하는 것이 가져온 효과는 다양한데, 기존의 대학은 시험에 최소한의 노력만을 기울였고, 여기에 노력을 쏟는 것은 주정부(state authorities)에 의해서 운영되는 면허시험이었다. 면허시험을 치르기 위한 인증(certificate)를 받기 위해서 학생들은 공식적 평가과정을 밟지 않거나 매우 조금만 밟아도 되었고, 대부분 출석만 잘 하면 인증을 받을 수 있었다. 해부학과 같은 소수의 과목에서만 시간을 들여서 구두시험을 치렀다. 과거에는 최종 면허시험이 유일한 summative grade였다.

Strengthening the responsibility of faculties had mixed effects. Previously faculties invested only a minimal effort with respect to examinations. This was left to the centrally organised state licensing examination administered by state authorities [Landesprüfungsamt]. Students received certificates [Scheine] with little or no formal assessment in each of the subjects required in order to register for the licensing examinations. Most often physical attendance during the course was sufficient to obtain the course certificate. Only a few subjects such as anatomy required time consuming oral examinations. Previously, on the final licensing examination certificate only one summative grade of the written multiple choice exams and the final oral examination appeared on the diploma.


이제는 각각의 과목이 반드시 grade로 평가되고 최종 학위에 표기되어야 한다. 한편으로 이러한 정책은 OSCE와 같은 평가법의 도입을 유도했고, 다른 한 편으로 이러한 시험을 도입하는 것이 작은 교실에서는 상당한 부담을 가져왔다. 예를 들어 psychosocial science 학과 등에서는 수용능력을 초과하는 구두시험은 치를 수가 없게 되었다.

Now each subject must be graded and appears on the final diploma. On the one hand this has led to the introduction of modern assessment tools to evaluate practical skills like the objective structured clinical examination (OSCE) in several faculties [33]. On the other hand time and staff consuming examinations turned out to be a burden especially for smaller departments. For example psychosocial sciences in the preclinical section had to stop administering oral exams exceeding their staff capacities.


새로운 면허시험은 다지선다형 필기시험과 구두시험으로 구성되어 있다. MCQ의 개발은 IMPP가 주관한다. 대학별로 나름의 교육과정이 있으나 IMMP는 필기시험에서 다뤄지는 주제의 카탈로그를 가지고 있다.

The new licensing examination consists of a written test with multiple choice questions (MCQs) and an (unstructured) oral examination. The administration and development of MCQs continues to be organised by the Institute for medical and pharmaceutical examination questions [Institut für Medizinische und Pharmazeutische Prüfungsfragen (IMPP)] [34]. Although each medical faculty has its own curriculum, the IMMP has a catalogue of topics covered by the written exams [Gegenstandskatalog].


면허시험의 앞 파트는 예전에 Physikum이라 불리던 것으로서 임상실습을 하기 위해서 이 시험을 반드시 통과해야 한다. 약 20%정도의 학생이 탈락하며, 두 차례까지 볼 수 있다. 5%학생이 결국 탈락하게 되며, USMLE step1에 해당하는 시험은 아니다.

The first part of the medical licensing examination [Erster Abschnitt der Ärztlichen Prüfung], traditionally called “Physikum”, is the first hurdle students have to take. In order to proceed to the clinical section, this examination must be passed. The average initial failure rate is roughly 20%. The examination can be repeated twice; about 5% of all students never pass. This exam is not equivalent to the USMLE step 1 (United States Medical Licensing Examination).


면허시험의 새로운 두 번째 파트는 Hammerexamen이라 불리며, 괴물시험(monster exam)이라고 번역할 수 있다. 이는 기존에 별개였던 세 개의 시험을 대체하는 시험으로 임상과학의 전체적인 스펙트럼을 모두 포괄한다. 필기시험과 구두+실기시험이 합해진 시험으로 구성되는데, 이 시험의 별명(괴물시험)이 말해주는 것처럼, 필기시험의 탈락율이 2%에서 9%로 치솟았다. 구두+실기시험을 탈락하는 학생은 적으며, 이는 이 시험에 대한 비판중 한 가지이다. 

The new second part of the medical licensing examination [Zweiter Abschnitt der Ärztlichen Prüfung] of the clinical year has colloquially been termed “Hammerexamen” which can roughly be translated as “monster exam”. It has replaced three previously separate examinations and covers the entire spectrum of the clinical sciences. It consists of a written exam and a combined oral and practical exam. This exam lives up to its nickname since the previously low failure rate associated with the written part rocketed from 2% to 9%. Only a few students fail the oral and practical examination, which is only one of several reasons that this exam format has been criticised [35]. 


학생들이 '괴물 시험'에 대한 준비에만 초점을 맞추다가 임상실습과 학습에는 소홀해진다는 비판도 있다. IMPP가 필기고사 문항을 드문 질환 위주로 만들면서 더 통합적이고 임상적으로 중요한 것을 소홀히한다는 의견도 있다. 비록 새롭게 도입된 사례중심 문항형식이 MCQ 문항을 많이 발전시켰다고 보기도 하지만, 의학적으로 특이한 사례를 암기하고 별로 중요하지 않은 사실들을 아는 것이 여전히 중요한 부분으로 남아있다.

It is also felt that final year students are less well prepared than previous generations who took the last written examination before entering the clinical year. It is suspected that students focus on preparing for the “monster exam” and are distracted from clinical practical work and learning [36]. It had been hoped that the tendency of the IMPP to create multiple choice questions around rare syndromes would be abandoned in favour of more interdisciplinary and clinically relevant topics. Although the new case-based format still consisting of multiple choice questions is considered a significant improvement, remembering medical oddities and irrelevant facts still remains important [37].


Ranking of medical faculties

독일에서 의과대학의 순위는 상대적으로 새로운 것으로, The German Academic Exchange Service는 연구/시설/학생평가 등등을 기준으로 평가를 하였다. 면허시험에서의 학생의 수행능력을 기반으로 한 평가도 가능하다. 

Ranking of faculties is rather new in Germany and, as elsewhere, dependent on the selection criteria. The German Academic Exchange Service has ranked medical faculties in various topics including research, infrastructure and student evaluation [38]. Ranking based on students’ performance in state licensing examination is also available [39]. Adjustment for differences in allocation of resources per capita or the proportion of foreign medical students has a significant impact on ranking.


Title

최종 면허시험을 통과한 학생은 의술을 행할 수 있는 면허가 주어지나 academic title이 붙은 academic degree는 주어지지 않는다. 졸업생들은 Arzt라는 전문직 타이틀을 쓸 수 있으나, 비공식적으로 일반적으로는 "Dr."라고 불리기도 한다. 다른 나라와 마찬가지로 학위논문을 쓰는 것이 "Dr.med"를 받기 위해서 필요하다. 70%의 졸업생이 학위논문을 마무리짓는다고 나오며, 이는 이것이 진로/승진과 환자 유인에 유리하기 때문이다.

A student who passes the final licensing examinations is awarded a license to practice medicine [Approbation als Arzt], but does not receive an academic degree with an academic title [40]. Graduates are authorised to use the German professional title Arzt/Ärztin (Physician), but are generally addressed informally with the honorary title "Dr." [Doktor]. As in other countries, writing a dissertation/thesis is an option required to obtain the academic degree “Dr. med.”. It is estimated that 70% of all graduates will eventually complete a dissertation, which is perceived to be important for career promotion and to attract patients [41].



Discussion

Implementation of reforms in medical education


Excellent doctors are the result of an excellent medical education. The new "Regulation of the Licensing of Doctors (AppOÄ)" has certainly fostered important improvements in the education of medical students in Germany. The increased interest in medical education is documented by the dynamic development of the German Society for Medical Education [Gesellschaft für Medizinische Ausbildung] [42] and the introduction of the first postgraduate Master of Medical Education (MME) programme in Germany in 2005 [43]. Previously the only German-speaking MME-program was offered by the University of Bern in Switzerland.


It is uncertain if the goals of the new AppOÄ have been achieved as there are no official reports available. However, some professional organisations have conducted surveys.


Strengthening the role of General Practice in the face of an anticipated shortage of general practitioners was one of the multiple goals of the reform. Although some faculties have founded new Departments of General Practice, more than half of all faculties have no such department [44]. Similarly the stipulated strengthening of palliative care and pain management has also not yet been achieved in all faculties [45]. A national survey of teaching in Geriatrics, which had not previously been a component of the curriculum but is now covered by a mandatory interdisciplinary teaching module “Medicine of aging and the elderly”, revealed that less than half of all medical faculties provide teaching in this topic [46].


Mandatory evaluation of teaching was also among the aims of the AppOÄ. The main purpose of evaluation is quality control but also distribution of funds [47]. The last national survey on the evaluation of medical teaching in Germany was performed in 2000 before the reform [48]. Multiple evaluations of courses have been reported (selected examples [49], [50]) however there is no national standard and reporting bias is likely.


Unlike other university programmes awarding degrees to students, medical faculties in Germany are not subject to formal mandatory accreditation and reaccredidation procedures, since the final degree is a license awarded by the state. Although the German Council of Science and Humanities [Wissenschaftsrat] [51] has evaluated medical faculties, it is left to the discretion of the states as to how to ensure compliance with the stipulated requirements [52]. So far only one faculty has been on probation in 2005. It is conceivable that the states, which are responsible for funding medical faculties, have a conflict of interest given that external accreditation might reveal deficiencies due to under-funding.


Barriers to the implementation of stipulated reforms

Enacting the new AppOÄ was a pure administrative act and unfortunately was not provided with a budget to ensure its implementation [53]. Medical faculties are facing incredible difficulties to fulfil all the new requirements. The reduction in the number of lectures and rise in bedside teaching has increased the need dramatically for both clinical teachers and available patients. Although lip service is paid to the commitment for medical education, young academics are not rewarded for their efforts, and teaching, which must compete with research and patient care, is sometimes considered a lost cause [54].


At the same time, virtually all university hospitals to which medical schools are attached are in serious financial crisis, partly due to a new invoicing system and budget cuts [55]. Some of the previously state-owned university hospitals have been privatised (e.g. Giessen and Marburg) or transformed into foundations (e.g. Göttingen). This has increased the already pressing need for separate accounting of patient care financed by hospital revenues and teaching, and research covered by state grants or third-party funds. This has turned out to be extremely difficult since a significant proportion of the faculty is actively involved in both [56]. Only a few medical faculties (e.g. Kiel/Lübeck, Dresden/Leipzig) are administered completely separately from university hospitals [57]. The funding of medical education has been described in more detail elsewhere [58].


European perspective

In 1999, the Education Ministers from 29 European countries including Germany adopted the Bologna declaration [59]. The principal goals of this were to permit easily readable and comparable university degrees within Europe and to introduce a system essentially based on two main cycles, undergraduate and graduate, thus increasing mobility within Europe. In fact the mobility of medical students is already hampered at a national level by the multitude of non-compatible curricula although the Bologna declaration should also theoretically apply to medical education. However, this idea is neither encouraged by the German Medical Association nor some other medical associations [60]. The main reason to reject the implementation of the Bologna declaration for medical training is the fear of introducing a fast track “barefoot doctor”.


Conclusion

Improving and adapting education of medical students to the health needs of the population is a continuous process. The new "Regulation of the Licensing of Doctors (AppOÄ)" in Germany has stimulated multiple excellent projects to help future doctors meet these needs, but there is evidence that some of the stipulated changes have not been implemented. This review is an initial attempt to assess the compliance with the requirements of the AppOÄ and the success of the changes stipulated therein. Unfortunately it has not been possible to do justice to the educational activities in all 36 faculties, and while it is recognised that only a few selected projects have been discussed here, it is clear that mandatory external accreditation and periodic reaccreditations of medical faculties needs to be established in Germany [61].



List of abbreviations used

  • AppOÄ: Approbationsordnung für Ärzte [Licensing Law for Medical Doctors]
  • GPA: grade point average
  • IMPP: Institut für Medizinische und Pharmazeutische Prüfungsfragen [Institute for medical and pharmaceutical examination questions]
  • MCAT: Medical College Admission Test
  • MCQ: multiple choice questions
  • PJ: Praktisches Jahr [final year in medical school]
  • TMS: Test für Medizinische Studiengänge [Test for medical education]
  • USMLE: United States medical licensing examination
  • ZVS: Zentralstelle für die Vergabe von Studienplätzen [Central office for the allocation of places in higher education]









 2009 Apr 2;7:Doc02. doi: 10.3205/000061.

Undergraduate medical education in Germany.

Abstract

The purpose of this article is to give international readers an overview of the organisation, structure and curriculum, together with important advances and problems, of undergraduate medical education in Germany. Interest in medical education in Germany has been relatively low but has gained momentum with the new "Regulation of the Licensing of Doctors" which came into effect in 2003. Medical education had required substantial reform, particularly with respect to improving the links between theoretical and clinical teaching and the extension of interdisciplinary and topic-related instruction. It takes six years and three months to complete the curriculum and training is divided into three sections: basic science (2 years), clinical science (3 years) and final clinical year. While the reorganisation of graduate medical education required by the new "Regulation of the Licensing of Doctors" has stimulated multiple excellent teaching projects, there is evidence that some of the stipulated changes have not been implemented. Indeed, whether the medical schools have complied with this regulation and its overall success remains to be assessed systematically. Mandatory external accreditation and periodic reaccreditation of medical faculties need to be established in Germany.

KEYWORDS:

Germany; reform; undergraduate medical education

Blended learning approach improves teaching in a problem-based learning environment in orthopedics - a pilot study

David A Back1,2,7*, Nicole Haberstroh3, Andrea Antolic4, Kai Sostmann5, Gerhard Schmidmaier6 and Eike Hoff3,7



Results

Participants (n = 53) rated their experiences very positively. An enhancement in knowledge was found directly after the course and at the final written test for both groups (p < 0.001). NESTOR users scored higher than non-users in the post-tests, while the OSCE revealed no differences between the groups.


Conclusions

This pilot study showed a positive effect of the blended learning approach on knowledge enhancement and satisfaction of participating students. However, it will be an aim for the future to further explore the chances of this approach and internet-based technologies for possibilities to improve also practical examination skills.

Background

최근 e-learning에 대한 관심과 연구 노력이 많아지고 있다.

In recent years, there has been a growing interest in research on the education and learning progress of students in medicine. Great effort has been put into knowledge transfer via internet-based electronic learning (e-learning[1].


의학교육에서 e-learning은 중요한 부분이 되었으며, e-learning과 면대면 교육과정을 혼합한 blended learning의 장점에 대해서도 많은 보고가 있다. 

E-learning has also become an integral part of medical education [2-10]. Various authors have shown that greatest benefit and student satisfaction is achieved when combining e-learning with face-to-face courses, as blended learning[2-4]. Blended learning comprises the systematic integration of online and face-to-face engagement to support and enhance a meaningful interaction between students, teachers and resources [11,12]. 


지식의 전달을 촉진하기 위해서 교육은 competent, appealing, recipient oriented 되어야 한다. 이러한 맥락에서 e-learning은 여러 방법을 통해 이를 달성할 수 있다.

When attempting to successfully facilitate the transfer of knowledge, it is essential that teaching be competent, appealing, and recipient oriented[5]. In this context, e-learning can be achieved e.g. 

by providing videos [6], 
podcasts [7] or
interactive diagnostic tools 
[8], 

...leading to a considerable improvement of knowledge transfer capabilities in a mix with face-to-face lessons [9,10]. However, more studies are still needed to proof the impact of e-learning and blended learning on the enhancement of students’ knowledge and clinical skills in general and in the field of orthopedics and traumatology particularly.


e-learning을 도입한 이후에 많은 연구들이 학생의 만족도를 조사하는데 초점을 두고 있다. 이는 e-learning을 받아들이고 활용하는데 있어서 중요한 요인이다. 또한 지식 및 술기의 습득에 미치는 영향을 분석한 연구도 있다.

After the launch of e-learning courses in recent years, many studies have focused primarily on evaluating students’ satisfaction – an important factor in acceptance and use of e-learning [13-15]. Others have additionally analyzed e-learning’s influence on the acquisition of knowledge or skills[3,6,8,9,12,16].


그러나 이와 같은 밝혀진 효과에도 불구하고 외상학, 정형외과학 교육에서 이러한 연구는 매우 적다. 근골결계 질환이 지난 수년간 급격하게 증가하고 있고, 학생 교육에서 이 질환의 진단과 치료가 좀 더 강조되어야 한다. E-learning은 다양한 멀티미디어의 활용으로 이 분야를 더 매력적으로 만들고 지식 향상을 더 도울 수 있으나, 여전히 많은 데이터가 필요하다.  

In traumatology and orthopedics education such studies are comparatively still rare [13,17,18], despite the fact that e-learning might substantially improve quality and success of teaching in these highly clinically and practically oriented disciplines. While the number of musculoskeletal diseases and injuries has been steadily increasing over the last years [19], data indicate that medical student education concerning the diagnosis and treatment of musculoskeletal diseases should be enhanced [20]. Here, e-learning could add appeal [21] and promote better knowledge and clinical skills [18] by providing useful multimedia adjuncts (e.g. videos, podcasts, or radiological cases). However, more data is still needed to guide the design of blended learning curricula in these subjects, questioning especially to what extend the use of e-learning might be beneficial and to investigate the effect of different approaches or configurations of e-learning.


이러한 문제를 풀기 위해 외상학/정형외과학의 파일럿 연구를 시도하였고, 연구진이 선택한 교육과정은 학제간 지식에 초점을 둔, PBL을 주로 활용하는 교육과정을 연구 대상으로 하였다. 다음의 질문에 대해 연구하고자 한다.

To further address these issues, we performed a pilot study in the teaching of students in orthopedics and traumatology. The chosen curriculum focused on strengthening interdisciplinary knowledge and heavily utilized problem based learning (PBL) with a student-centered teaching approach, encouraging problem-oriented, self-directed and self-organized learning. To evaluate different aspects of incorporating a supplementary e-learning component, following questions were asked in this study:

1. Will students appreciate an additional e-learning offer in a blended learning context?

2. Will user of the e-learning offer show a superior improvement in theoretical knowledge compared to non-users?

3. Will users perform better in clinical examination skills compared to non-users?

The findings should allow a more informed discussion about the aspects that may have to be considered when integrating blended learning approaches into a PBL curriculum of orthopedics and traumatology.



Methods

Setting

All students taking part in the pilot study were in their fifth year of medical studies in winter semester 2009/ 2010. In their curriculum, for the first five of six years (two semesters per year) teaching was organized into block courses, covering different topics along a longitudinal learning helix. Following basic orthopedic concepts in the first semester, a two week block course, “Upper Extremities and Spine”, was specifically dedicated to increase knowledge of traumatologic and orthopedic diseases and furthering clinical skills in the ninth semester. Participation in the latter course was mandatory for all students and this course was chosen to incorporate a new e-learning module called NESTOR (network for students in traumatology and orthopedics), provided through the learning management system (LMS) Blackboard (Blackboard Inc., Washington D.C., USA) with multiple features:


–Orthopedic examination videos (covering inspection, palpation, motion and special tests) (Figure 1).

thumbnailFigure 1. Examination video. Legend: Example of an examination situation of the shoulder (here: Special tests – Apprehension-Test) as shown in the videos on NESTOR.

–Interactive radiology cases with X-rays, MRI- or CT-images and a patient history. After being asked to generate and enter a hypothesis for the diagnosis, the correct answer was given along with explanations for the ensuing treatment.

–Audiovisual podcasts for common traumatologic or orthopedic diseases (with medical history, diagnostics, therapy, and prognosis).

–Multiple-choice questions were available all the time to enable the students to self-test their gain in knowledge.


Design of the study

Prior to the beginning of the course, students were informed where to find and how to access NESTOR on the LMS Blackboard and about its contents. Clinical tutors were provided with similar information. All students of the semester who were as well participants in the course were asked to take part in the study. The option of enrolling in NESTOR was voluntary. All participants had continuous access to NESTOR during the whole semester. The e-learning module contained no information not otherwise taught (e.g. in classes or regular study books). A tracking function to detect the individual accessed e-learning tools or the time students spend with them was not included in this pilot study.


All students were asked to complete a 20-item multiple-choice test before (pre-test), directly after the block course (post-test 1), and then three months later at the end of the semester (post-test 2). For every item one correct and four wrong answers were given. Tests were created by four independent clinical specialists without knowledge about the content of NESTOR. All tests were anonymized using code names. Students were asked to tick a box if they had used NESTOR for learning and preparation during the semester. Those who did were regarded as “user”, those who did not as “non-user”. At the end of semester students had to pass a mandatory objective structured clinical examination (OSCE) with taking patients history, performing a physical examination and diagnosing actor-patients. The results of the OSCE were taken as evaluation of practical examination skills. Additionally, students’ opinion about the course was evaluated anonymously. As in the written tests (see above) students were asked to tick a box, if they had used NESTOR during the semester and to continue with different questionnaires for NESTOR users and non-users (5-points Likert scale or self-response short answers):

1. Users were asked for (1) their use of NESTOR during the study and also their prior use of the LMS Blackboard to get an idea of the experiences with electronic media and e-learning in general, (2) efficiency of use and structure of NESTOR, (3) satisfaction with its contents and technique, (4) general information concerning the course, and (5) personal information (20 items – 17 Likert scale, 3 short answers).

2. Non-users were asked for (1) their use of the LMS Blackboard, (2) general information concerning the course, (3) reasons for not having used NESTOR and general acceptance of e-learning, (4) personal information (14 items – 12 Likert scale, 2 short answers).

Results of Likert-scaled questions were tabulated and free text answers were reviewed for recurring topics by two reviewers independently.


Written informed consent was obtained from all participants including the allowance to use test and evaluation results as anonymous data for the study (regarding students) and to use a picture of the video for publication (regarding the “actors” of the video, both medical doctors). Additionally, permission was obtained from the responsible educational Ethikkommission der Charité - Universitätsmedizin Berlin.


Statistical analysis

Written tests were validated by calculating Cronbach’s Alpha. Data of the written tests were analyzed for changes between pre- and post-tests as well as post-test 1 and 2 within the groups of users and non-users using unpaired student’s t-test. To detect differences in the evaluation between NESTOR users and non-users a chi-square test was performed for each question. A p-value less than 0.05 was considered to indicate a significant (< 0.01: highly significant) difference between the observations and the expectations based on the null-hypothesis. Statistical analysis was performed with SPSS® 17.0 statistics software (SPSS Inc., Chicago, IL, USA) and GraphPad Prism®5 (GraphPad Software Inc., San Diego, Ca, USA).



Discussion

정형외과학과 외상학 분야에서 blended learning의 효과를 본 첫 번째 연구이다.

The purpose of this pilot study was to give first impressions of the effect of a blended learning concept in orthopedics and traumatology called NESTOR both on students’ satisfaction and on its contribution to acquisition of knowledge and clinical skills in a problem-based learning curriculum, which already provides an intensely practice-oriented teaching environment. To the best of the author’s knowledge, this is the first study examining the influence of blended learning not only on satisfaction, but also on knowledge and practical clinical skills of students in traumatology and orthopedics, two highly practically oriented medical subjects.


학생들의 의견과 수용정도를 보는 것은 e-learning을 평가하는 첫 단계이다. 기존 연구들과 마찬가지로 high approval을 확인할 수 있었다.

Evaluations of students’ opinion and acceptance can be seen as first step when establishing a new e-learning program [4,14,21]. Consistent with the literature, this study revealed a high approval of the participating users for the additionally offered e-learning contents. While a broad acceptance is crucial for successful e-learning implementation [1], it is also important to evaluate its influence on students’ gain of knowledge and skills [9].


지식 향상에 대한 평가를 수행하였고, 필기시험을 활용하였다. e-learning이 지식 향상에 도움이 된다고 보고하는 연구도 있고, 그렇지 않은 연구도 있다. 이 연구에서 우리는 pre- 와 post- 간에 유의미한 차이를 확인하였다. NESTOR 사용자 그룹이 더 높은 점수를 받았을 뿐만 아니라 향상도도 더 높았다.  그러나 이러한 결과를 NESTOR 덕분이라고만 해석하는 것은 조심해야 한다. 최근 연구에서 Rpwe 등은 clinical competency의 향상에 있어 blended learning의 효과를 평가하는 것은 rudimentary하며 71개의 연구 중 64개가 방법론적으로 문제가 있었다.

Thus, as second step, not only the impact on users’ satisfaction, but also on their knowledge should be demonstrated [6,21,22]. For this pilot study we have chosen newly developed written tests to evaluate improvement in theoretical knowledge, which seem to be valid as indicated by the measured Cronbach’s Alpha values. While some studies showed benefits of e-learning on improvement of students’ knowledge [6,23] others did not – despite of positive evaluation[2,8,22]. In this pilot study, we found a significant improvement from pre- to post-tests for both groups. NESTOR users scored better in the written post-tests than non-users and showed further improvement between post-test 1 and 2. A possible interpretation for this success in the group of NESTOR users may be students’ very positive attitude towards e-learning and a high satisfaction with structure and contents. However, these results should be interpreted carefully, especially when referring this effect exclusively to the use of NESTOR. In a recent review, Rowe et al. [12] showed that the existing data to evaluate an improvement of clinical competencies by blended learning can still be regarded as rudimentary. It seemed to be a problem of the study design in a clinical environment to determine the effect of blended learning exclusively. Rowe et al. identified 71 studies dealing with the role of blended learning in the clinical education of healthcare students, but only 7 articles were enrolled for the review due to methodological flaws of the remaining 64.


지식 향상에 대한 평가의 다음 단계로는 clinical skill의 향상을 보는 것이 될 것이며, 일부 연구에서 수행한 바 있다. OSCE결과 사용 여부에 따른 차이는 없었다. 이는 기존의 다른 연구와 유사한 결과이다. 이에 대한 한 가지 설명은 이미 존재하는 highly clinically oriented curriculum이 추가적인 e-learning 노출에 대한 효과가 나타나기 어렵게 만들었다는 것이다.

As potential third step it might be anticipated that even practical clinical skills may be improved through blended learning in this context [9], which has been shown in some studies [9,16,24]. The results of the OSCE revealed no differences between users and non-users in this pilot study with high scores in both groups. These findings are consistent with other studies which failed to detect significant benefits on examination performance or other practical clinical skills with e-learning implementation [21,25,26]. A possible explanation could be that the pre-existing, highly clinically oriented curriculum made it difficult for any additional e-learning exposure to further improve skills.


이러한 맥락에서 e-learning을 통해 달성할 수 있는 것이 무엇인지에 대한 의문이 있을 수 있다. 임상skill은 개인적 경험과 훈련에 의한 것이지 e-learning을 사용한 여부에 달린 것이 아니라는 주장이 가능하다. 따라서 이러한 상황에서 blended learning 접근법을 적절히 조절하여 적용을 가능하도록 하는 방법이 무엇일지 연구해볼 필요가 있다. 그러나 적어도 지식의 향상 측면과 전반적으로 높은 approval을 보면 NESTOR를 계속 지속시킬 만한 주장의 근거는 된다고 할 수 있다. 또한 해부학과 같은 다른 과목의 e-learning과 연결시키는 것도 좋을 것이다.

In this context, the question may arise what e-learning potentially can achieve [1]. It can be argued that clinical examination skills will always be preferentially based on personal experiences and training rather than on the use of e-learning – unlike acquiring skills in other areas such as radiological diagnosis [16]. In the presented pilot study, e-learning enhanced competencies for gaining theoretical medical knowledge. Further research will be necessary to determine, if it is possible to adjust the components of a blended learning approach in this context to achieve also an improvement of practical skills compared to mere face-to-face teaching. However, as knowledge about diseases is an important basis for developing treatment and examination skills, this and the overall high approval provide good arguments for the continued use of NESTOR in the preparation for the tested subjects. Following suggestions of the non-users, acceptance of the program might be further increased by improving announcements about it. Additionally, it could be made even more appealing with links to e-learning programs of other subjects (e.g. anatomy) of the faculty.


e-learning에 대한 자발적 사용 의사와 관련해서 살펴보면, NESTOR의 사용 여부가 LMS Blackboard의 사용 여부와 매우 연관되어 있었기 때문에 LMS를 도입함으로서 e-learning의 자발적 활용 가능성을 높일 수 있다. 전체 교수들이 e-learning을 활용하면 학생들의 e-learning에 대한 친밀도를 높일 수 있을 것이며 자발적인 것 뿐만 아니라 심지어는 의무적으로 e-learning을 활용하게 하는 것 역시 가능할 것이다.

Concerning the willingness to use e-learning offerings voluntarily, an additional inference can be taken from this study en passent: As the use of NESTOR was significantly linked to the use of LMS Blackboard, the likelihood of voluntarily using an e-learning offering may be directly connected to the acceptance and use of the hosting LMS. This would require the need for the entire faculty to join in a combined effort to establish e-learning offerings broadly to increase students’ familiarity with such resources. Thereby, voluntary and perhaps even mandatory use of e-learning components could be increased.












 2014 Jan 27;14:17. doi: 10.1186/1472-6920-14-17.

Blended learning approach improves teaching in a problem-based learning environment in orthopedics - a pilotstudy.

Abstract

BACKGROUND:

While e-learning is enjoying increasing popularity as adjunct in modern teaching, studies on this topic should shift from mere evaluation of students' satisfaction towards assessing its benefits on enhancement of knowledge and skills. This pilot study aimed to detect theteaching effects of a blended learning program on students of orthopedics and traumatology in the context of a problem-based learning environment.

METHODS:

The project NESTOR (network for students in traumatology and orthopedics) was offered to students in a problem-based learning course. Participants completed written tests before and directly after the course, followed by a final written test and an objective structured clinical examination (OSCE) as well as an evaluation questionnaire at the end of the semester. Results were compared within the group of NESTOR users and non-users and between these two groups.

RESULTS:

Participants (n = 53) rated their experiences very positively. An enhancement in knowledge was found directly after the course and at the final written test for both groups (p < 0.001). NESTOR users scored higher than non-users in the post-tests, while the OSCE revealed no differences between the groups.

CONCLUSIONS:

This pilot study showed a positive effect of the blended learning approach on knowledge enhancement and satisfaction of participating students. However, it will be an aim for the future to further explore the chances of this approach and internet-based technologies for possibilities to improve also practical examination skills.

PMID:
 
24690365
 
[PubMed - in process] 
PMCID:
 
PMC3905287
 
Free PMC Article


Cutting costs of multiple mini-interviews – changes in reliability and efficiency of the Hamburg medical school admission test between two applications

Johanna C Hissbach1, Susanne Sehner2, Sigrid Harendza3 and Wolfgang Hampe1*





Results

The overall reliability of the initial 2009 HAM-Int procedure with twelve stations and an average of 2.33 raters per station was ICC=0.75. Following the improvement actions, in 2010 the ICC remained stable at 0.76, despite the reduction of the process to nine stations and 2.17 raters per station. Moreover, costs were cut down from $915 to $495 per candidate. With the 2010 modalities, we could have reached an ICC of 0.80 with 16 single rater stations ($570 per candidate).


Conclusions

다면인적성면접(MMI)의 비용-효과성을 높이려면, 점수체계/평가자 훈련/시나리오 개발에 투자하는 편이 좋다. 또한 스테이션 수를 늘리는 것이 스테이션당 평가자 수를 늘리는 것이 낫다. 그러나 80%이상의 reliability를 달성하고자 한다면 약간의 개선을 위해서도 엄청난 비용이 들어간다.

With respect to reliability and cost-efficiency, it is generally worthwhile to invest in scoringrater training and scenario development. Moreover, it is more beneficial to increase the number of stations instead of raters within stations. However, if we want to achieve more than 80 % reliability, a minor improvement is paid with skyrocketing costs.

Keywords: 

Multiple mini interview; Cost-effectiveness analysis; Reliability; Optimization


Background

Admission to medical school is a field of feisty debate. Usually, measures of academic achievement and interview performance are used for admission decisions. Assets and drawbacks of these different approaches allude to psychometric properties and costs. School grades such as grade point average (GPA) and high stakes ability tests are usually easily administered, cost efficient and psychometrically sound but they disregard personality factors that might be crucial for a medical career (e.g. [1-3]). On the other hand, interviews have high face validity [4], but evidence for the reliability and validity of panel interviews is scarce.


The multiple mini-interview (MMI) with its multiple sampling approach is widely accepted by raters and candidates [5-7], and it is regarded as a comparatively reliable measure of non-cognitive skills [8]. However, reliability coefficients vary substantially depending on the target population, setting variables, study design, and methods used, which impedes the comparison of results. In undergraduate medical school selection, reliability measures obtained on the basis of generalizability method [9] ranged from 0.63 to 0.79 [10-13]. Most coefficients for nine station procedures with one or two observers per station lie around G=0.75.


Another concern specifically addresses the cost-effectiveness of MMI. The costs and the effort of faculty are essential for officials to refrain from introducing MMIs [10]. The expenses associated with such a procedure depend mainly on varying modalities of the process. Even though there is evidence that MMIs are more cost-effective than traditional panel interviews [6,14,15], costs are still high as compared to paper and pencil tests. Eva et al. report the costs of the actual process on the interview day (about $35 per candidate) but do not include the costs generated in the framework of project preparation and organization [6]. Rosenfeld et al. provided an overview of the time requirements for mounting multiple mini-interviews and traditional interviews [14]. To interview 400 candidates with the MMI procedure they calculated a maximum of 1,078 staff hours (278 staff hours for the organization and 800 observer hours). Additional costs of $5,440 arose from the creation of stations ($50 per station for three hours creation time), infrastructure, and miscellaneous expenses. If we assume an average hourly rate of $50 for their staff, then the total costs would be approximately $150 per candidate.


In Tel-Aviv, Ziv et al. developed a medical school admission tool with MMI concepts (MOR) and found the inter-rater reliability of the behavioral interview stations was moderate [16]. The total cost of MOR process was approximately $300 per candidate but further information on the existing costs has not been provided.


In another study, costs of an Australian MMI procedure from 2009 were roughly AU $450 per candidate [17] – the costs reported, however, were mostly on candidates’ side, with airfares being the major factor.


Student selection at Hamburg medical school

In the 1990s, Hamburg Medical School conducted unstructured interviews for admission. Many faculty members were dissatisfied with this procedure, and the interviews were stopped within the scope of a change in federal law. With the introduction of a test in natural sciences for student admission in 2008 [18,19], the significance of psychosocial skills came to the fore. In March 2009, the faculty board decided to adopt the MMI format for a pilot test with a small number of candidates, aiming for a stepwise selection procedure in 2010: The GPA and HAM-Nat scores were applied to preselect candidates whose psychosocial skills were then assessed by the HAM-Int (“Hamburg Assessment Test for Medicine - Interview”).


The HAM-Int pilot (2009)

In a survey among the heads of clinical departments and members of the curriculum committees the following eight psychosocial characteristics received the highest ratings: integrity, self-reflection, empathy, self-regulation, stress resistance, decision-making abilities, respect, and motivation to study medicine. The participants of a faculty development workshop wrote the MMI scenarios, keeping the specified psychosocial skills in mind. These drafts were later discussed with psychologists and educational researchers and thereupon modified or rejected. Some of the defined skills were wide ranging or could not to be validly tested (e.g. integrity). Therefore, it was impossible to achieve a word-for-word translation of scenario characteristics. In total, twelve five-minute stations were assembled for the 2009 circuit.


We found a relatively low overall reliability coefficient (ICC=0.75 for twelve stations and a mean of 2.3 raters per station) as compared to those reported in other studies [20]. This raised the question as to which actions would enhance the reliability of the multiple mini-interview. Uijtdehaage et al. [21] found that a few changes in the procedure improved the reliability from G=0.59 to G=0.71. The increase in reliability was mainly due to a rise in candidate variation. The authors argue that maybe the change of venue – such as interviews were conducted in a different building – made the procedure less intimidating and therefore less stressful for candidates.


The feedback of raters and candidates drew our attention to the parameters, i.e. scenarios, score sheets, and rater training, aimed at improving reliability. We compare the results from the 2009 pilot test and the 2010 procedure.


This paper focuses on two aspects of MMI improvement: fine-tuning and cost-effectiveness. Our research questions were: Did our actions to improve the procedure enhance overall reliability? Which is the most efficient and practicable way to reach satisfactory reliability?

Methods

Candidates

In 2009, applicants for Hamburg Medical School were asked to state if they preferred to take the HAM-Nat test or the HAM-Int. We used the HAM-Int pilot to award 30 university places on the basis of interview results (in combination with GPA). The remaining places were allocated by HAM-Nat results (in combination with GPA). Among the 215 applicants who preferred the interviews to the HAM-Nat test, those 80 with the highest GPA were invited. The others were assigned to the HAM-Nat test. In 2010, we felt prepared to test 200 candidates who were preselected by the HAM-Nat test and GPA. All candidates took the HAM-Nat test, and those with excellent GPA and HAM-Nat scores (rank 1–100) were admitted without further testing, while the next 200 were invited to take the interviews. One hundred and fifteen further places were available. All candidates gave written informed consent.


Procedure

All interviews of one year took place on a single day in parallel circuits and consecutive rounds. Interviewers remained at their station during the day. Candidates were randomly assigned to circuit and round. In 2010, the number of circuits was increased from two to four and the number of rounds from three to five. To preclude a leak of scenario contents, all candidates checked in at the same time in the morning in 2009. As candidates perceived the waiting period before the start of the interviews as being quite stressful, in 2010 all candidates checked in just before they started their interview cycle. We also provided the raters with personalized score sheets in order of appearance of candidates, which substantially improved the interview cycle. An overview of the changes made to the procedure is given in Table 1.

Table 1. Changes made to the procedure (2009 – 2010)


Stations

In 2009, twelve five-minute stations with 1.5 minutes change-over time were assembled. Actors experienced with objective structured clinical examinations (OSCEs) from the in-house simulated patients program were trained for six scenarios. We provided prompting questions for the interviewers for the other six stations.

As it had turned out to be challenging to write scenarios which reflected the eight different target variables, the steering committee decided to focus on a core set of three in 2010: empathy, communication skills, and self-regulation. In 2010, nine five-minute stations were assembled. Those four stations that appeared to have worked best in 2009 were refined and reused, and five new stations were developed with more time and effort spent into testing and revision. In total, five stations involved actors.


Score sheets

The 2009 scoring sheets comprised three specific items and one global rating on a 6-point Likert scale. The numerically anchored scale ranged from 0–5 points. The specific items reflected e.g. communication skills, the formal presentation of a problem, empathy or respect in a social interaction, depending on the main focus of the station. The global rating was meant to reflect overall performance, including aspects not covered by the specific items. As the two lowest categories were only used in less than 5% of the global ratings, we changed the scale to a verbally anchored, 5 point-Likert scale in 2010. The scale ranged from 1 (very poor) to 5 (very good). In a thorough revision of all score sheets, we included detailed descriptions of unwanted and desired candidate behavior as anchors at three points along the scale (very poor performance, mediocre performance and very good performance). Raters were encouraged to use the full range of scores.


Raters and rater training

Hospital staff volunteered to take part in the interviews. Raters were released from work for the interview day within the scope of their regular contracts to be involved in the process. Mixed-gender rater teams of at least one professional from the psychosocial department and one experienced clinician were randomly assigned to stations to include a broad spectrum of judgments. The rationale to do so originated from the fact that not all candidates encountered the same set of interviewers. We aimed to ensure that all candidates saw an equal number of men and women as well as of psychologists and physicians.

All raters received a general instruction to familiarize them with the MMI procedure. They were then grouped within their specific stations, discussed their scenario, and had several practice runs with simulated candidates (students) to standardize scoring between the parallel circuits. While in 2009 the rater training session of two hours was held just before interviews started, the training was extended to a four hour session on the day preceding the interviews in 2010. While in 2009 interviewers rated the candidates’ performance, we refrained from this practice in the following year as a result of the interviewers’ feedback. They stated that is was too demanding to interview and to give a reliable rating at the same time.


Statistical analysis

Due to the naturalistic setting we have a partially crossed and nested design. Different sources of variability were estimated by means of a random intercept model with restricted maximum likelihood (REML) method. All analyses were conducted using IBM SPSS Statistics, Version 19.0.0 (2010).

As each candidate encountered all twelve or nine stations, respectively, candidates were fully crossed with stations but nested within circuit. Raters were nested within station and circuit as each rater was trained for one specific station. We constructed two different models. In the first model we examined the different sources of variability (random intercepts): candidate, station, rater, and candidate*station. The candidate effect reflects systematic differences in performance between candidates. The station effect represents systematic differences in station difficulty, while the candidate*station effect accounts for differences in the way candidates coped with the different stations. This effect is non-systematic and reflects a candidate specific profile of strengths and weaknesses with regard to stations. As raters remained at their station throughout the test, systematic differences in stringency (rater effect) could be estimated, while the rater*candidate effect (rater candidate taste) could not be separated from error. We apportioned all remaining variance to this term.

Corresponding to Generalizability Theory [22] we determined sources of measurement error by means of a multilevel random intercept model [23]. We took the ICCs as a G-coefficient for relative decisions as we included only those terms that affect the rank ordering of candidates. The reliability of the procedure is the proportion of variance attributable to candidates to total variance. As candidates were assigned to different sets of raters, systematic differences in rater stringency can have an effect on the ranking of candidates. Therefore, we adjusted for rater stringency as proposed by Roberts et al. [24] by including a fixed rater effect.

Unwanted sources of variability are due to the candidate specific station differences (Vcand*stat), namely candidate station taste, while systematic differences in station difficulty have no effect on the rank order, as all candidates encountered the same stations. All remaining residual variance was attributed to rater candidate taste (Vcand*rater). The following formula was used for the calculation of the overall reliability:

<a onClick="popup('http://www.biomedcentral.com/1472-6920/14/54/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1472-6920/14/54/mathml/M1">View MathML</a>

As a measure of inter-rater reliabilities (IRR) in the different stations we report intraclass correlations (ICC) for average measures (consistency) with two-way random effects.












 2014 Mar 19;14:54. doi: 10.1186/1472-6920-14-54.

Cutting costs of multiple mini-interviews - changes in reliability and efficiency of the Hamburg medical schooladmission test between two applications.

Abstract

BACKGROUND:

Multiple mini-interviews (MMIs) are a valuable tool in medical school selection due to their broad acceptance and promising psychometric properties. With respect to the high expenses associated with this procedure, the discussion about its feasibility should be extended to cost-effectiveness issues.

METHODS:

Following a pilot test of MMIs for medical school admission at Hamburg University in 2009 (HAM-Int), we took several actions to improvereliability and to reduce costs of the subsequent procedure in 2010. For both years, we assessed overall and inter-rater reliabilities based on multilevel analyses. Moreover, we provide a detailed specification of costs, as well as an extrapolation of the interrelation of costsreliability, and the setup of the procedure.

RESULTS:

The overall reliability of the initial 2009 HAM-Int procedure with twelve stations and an average of 2.33 raters per station was ICC=0.75. Following the improvement actions, in 2010 the ICC remained stable at 0.76, despite the reduction of the process to nine stations and 2.17 raters per station. Moreover, costs were cut down from $915 to $495 per candidate. With the 2010 modalities, we could have reached an ICC of 0.80 with 16 single rater stations ($570 per candidate).

CONCLUSIONS:

With respect to reliability and cost-efficiency, it is generally worthwhile to invest in scoring, rater training and scenario development. Moreover, it is more beneficial to increase the number of stations instead of raters within stations. However, if we want to achieve more than 80 %reliability, a minor improvement is paid with skyrocketing costs.

PMID:
 
24645665
 
[PubMed - in process] 
PMCID:
 
PMC3995077
 
Free PMC Article


[프리미엄] 좋은 머리만큼 '따뜻한 심장'도 지녔는가… 달라진 醫大 면접

[출처] 본 기사는 조선닷컴에서 작성된 기사 입니다


서울大 의대서 '多面 인·적성 면접'… 수능 만점자도 떨어졌다는데

뭘 물어보나 
친구가 입시 자기소개서에 허위내용 쓴 것 알게 되면? 
친구들과 인도여행 간다면… 돈 마련·역할 분담 어떻게?

핵심은 人性과 소통능력 
60분간 6개 면접실 돌아… 교수 12명이 속사포 질문 
학생들 "답변 꾸미려고 해도 본모습 드러나게 되더라"

고득점 많은 의대서 비중 커져… 캐나다·미국 등 이미 시행 

국내 의대들도 도입 늘어나, 일부선 변별력 놓고 의문


지난 1월 18일 서울 종로구 연건동 서울대 의대 교육관의 2014학년도 정시 모집 면접 현장. 복도 양측에 각 6개씩, 총 12개의 면접실 앞에는 긴장한 표정이 역력한 수험생들이 한 명씩 문 앞에 섰다. 벨 소리가 울렸고, "지금부터 문에 붙어 있는 종이에 적힌 내용을 읽으라"는 안내 방송이 나왔다. 정확히 2분 뒤 다시 벨과 안내 방송이 나오자 수험생들은 문을 열고 면접실 안으로 들어갔다.


방 안엔 교수 면접관 2명이 앉아 있었다. 면접관들은 8분 동안 수험생에게 속사포 같은 질문 공세를 펼쳤다. 종료 벨 소리와 함께 수험생들은 한 칸씩 옆방으로 이동했고, 질문만 다를 뿐 똑같은 과정이 되풀이됐다. 수험생들은 이런 식으로 60분 동안 모두 6개의 면접실을 돌았다. 모든 과정은 마치 톱니바퀴가 돌아가는 듯했다. 중간에 쉬는 시간도 없었다


서울대 의대가 2012학년도부터 도입한 이 면접은 '다면(多面) 인·적성 면접(MMI·Multiple Mini Interview)'. 의사로서의 기본적인 인성과 적성을 검증하는 면접법이다. 처음엔 의학전문대학원 수시에 적용했고 이후 2013학년도 의대 수시, 2014학년도 의대 정시로 확대했다





◇의사, 인성과 적성이 중요하다


서울대 의대는 MMI 도입 취지에 대해 "의사소통 능력과 라포르(rapport·의사와 환자의 심리적 신뢰) 형성 능력이 있는 지원자를 선발하고, 공부만 잘하는 지원자는 걸러내기 위한 시도"라고 밝혔다.


의대생을 뽑을 때 인성과 적성을 중시해야 한다는 것은 의학계의 오랜 화두(話頭)다. 사정은 외국도 마찬가지다. 뉴욕타임스는 몇 년 전 '의사 지망생을 위한 새로운 인성·사회성 테스트'란 제목의 기사에서 "미국 의대 가운데 MMI를 도입하는 곳이 늘고 있다"고 전했다. 그 이유로는 ▲실력 좋은 의사들이 환자·간호사 등과 소통이 안 돼 충분히 막을 수 있었던 환자의 죽음을 막지 못하는 사례가 늘고 있으며 ▲현대 의술이 갈수록 팀플레이 위주로 전개돼 의사에게 소통 능력이 요구되고 있는 점을 꼽았다.


MMI는 지난 2001년 캐나다 맥마스터 의대가 처음 도입했으며, 현재는 캐나다 대부분 의대가 시행하고 있다. 이후 미국으로도 넘어가 뉴저지, 캘리포니아, 버지니아, 오하이오 등의 주요 주립 의대가 실시 중이다. 미국 명문 사립 의대 중엔 스탠퍼드가 2010년 도입했다.


우리나라에서는 강원대 의전원이 2008학년도 입시에서 처음 시행했고, 한림대 의대가 2011학년도 입시에 도입했다. 그 외 인제대 의대, 가천대 의대 등이 시행 중인 것으로 알려졌다. 또 최근 발표된 서울대 2015학년도 입시전형 안내에 따르면 이 대학 수의대·치대도 수시 전형에서 MMI를 실시할 계획이다.




◇학생들… "살아온 모습 드러나더라"


서울대 의대의 MMI는 총 6개의 방으로 구성됐다. 이 학교 입학 관계자는 "면접실 6개 중 1개는 학생들이 제출한 서류나 학생부 등을 확인·검토하는 방"이라며 "나머지 5개 방에서는 의대 산하의 문항개발위원회가 자체 개발한 문항으로 면접을 진행한다"고 설명했다.


서울대 의대 신입생들은 "면접에 나온 문항은 수학·과학 능력을 검증하는 것이 아니었다"고 입을 모았다. 예를 들어 '친구가 대학 입시 자기소개서에 허위·과장 내용을 기재해 제출한 사실을 알게 됐다. 어떻게 할 것인가' '친구 5명과 인도 여행을 떠나기로 했다. 경비 마련, 역할 분담 등을 어떻게 할 것인가' 등 일상적인 내용을 담은 문항이 주로 제시됐다고 했다. 방에서는 문항과 관련된 추가 질문이 쉴 틈 없이 이어졌다고 한다.


(출처 : http://blog.chosun.com/blog.log.view.screen?userId=besetohan&logId=7417996)

Attitudes towards statistics of graduate entry medical students: the role of prior learning experiences

Ailish Hannigan1,2*, Avril C Hegarty3 and Deirdre McGrath1,2




Background

근거중심의학의 정의 : ‘conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients’ [1]

과학적 데이터를 생산하고 분석하여, 분석의 결과를 근거로 추론을 해내는 통계학의 역할을 감안하면 의과대학생들은 그 교육과정에서 통계학을 배울 필요가 있다. 

임상현장에 있는 의사들도 확률과 통계를 이해하는 것이 중요하다고 생각함.

Evidence based medicine has been defined as the ‘conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients’ [1]. Establishing best evidence involves systematically collecting and analyzing scientific evidence to answer a specific clinical question. Given the central role of statistics in the production and analysis of scientific data and in drawing inferences from that analysis, most medical students are expected to gain some knowledge of statistics as part of their education. A survey of practicing clinicians identified an understanding of probability and statistics as being useful for accessing clinical guidelines and evidence summaries, explaining levels of risk to patients, assessing medical marketing and advertising material, interpreting the results of a screening test, reading research publications for general professional interest, and using research publications to explore non-standard treatment and management options [2]. While statistics is increasingly taught as part of the medical curriculum, it can be an unpopular subject and feedback from students indicates that some find it more difficult than other subjects [3].


통계학을 가르치는 것은 지식 뿐만 아니라, 정량적 기술을 익히도록 동기부여를 하는 의미도 있다.

통계학에 대한 긍정적 또는 부정적 자세는 자신의 일과의 관련성, 통계학의 가치에 대한 생각, 난이도 등에 따라 달라짐.

통계학에 대해 긍정적인 태도를 갖는 학생들은 아래와 같이 생각함.

The teaching of statistics is not just about imparting knowledge but also about motivating students to continue to learn the quantitative skills they will need in their professional lives, so the role of attitudes towards statistics requires attention. Attitudes towards statistics are the extent to which learners hold positive or negative feelings towards statistics and their perception of its relevance, value and difficulty [4]. Positive attitudes towards statistics have been described [5] as the need for students to

• believe that they can understand and use statistics,

• think that statistics is useful in their professional lives,

• recognize that statistics can be interesting,

• be willing to invest the effort needed to learn statistical thinking and skills, and,

• realize that statistics is not easy but it also is not too difficult to learn.


통계학에 대한 태도와 통계학 시험 점수의 관계는 명확하지는 않으며, small to moderate relationship만이 밝혀진 상태이다. 그러나 통계학을 교실 바깥에서도 더 해보려고 한다거나, 미래에 통계학 강의를 듣는 것과는 연관성이 있다.

Postgraduate에 대해서 통계학에 대한 태도에 관한 연구는 부족하다. 

특히 Graduate entry medical program에서 이러한 연구가 특히 중요한 이유는, 이 학생들은 과거에 quantitative course를 수강한 적이 있고, 이것으로 인하여 선입견이 있을 수 있다. 그러나 이러한 선입견은 통계학에 대한 것이라기보다는 수학에 대한 것이고, 이것이 통계학 교육을 더 어렵게 만드는 요인이 된다. 이들은 통계학을 수와 계산, 공식, 정답을 찾는 것에 초점을 두는 수학이라고 생각하는 경향이 있다.

The relationship between attitudes towards statistics and achievement in examinations is not clear with most studies only finding a small to moderate positive relationship between attitudes towards and performance in statistics [4,6]. Attitudes may, however, have a role in influencing the learning process and the willingness of students to engage with statistics outside the classroom and attend statistics courses in the future [7]. There has been considerable focus on attitudes towards statistics of secondary school and undergraduate students but little is known about attitudes towards statistics of postgraduates. Zhang et al. [8] explored the attitudes of postgraduate medical students in China and concluded that while the students had positive attitudes towards statistics, they perceived it as a difficult subject. Understanding attitudes towards statistics on entry to graduate entry medical programmes is particularly important, given that many students may have been exposed to quantitative courses in their previous degree and bring preconceptions of their ability and interest to their medical education programme. These preconceptions may be about mathematics rather than statistics which makes the teaching of statistics particularly challenging. Ben-Zvi and Garfield [9] refer to the tendency for students to ‘equate statistics with mathematics and expect the focus to be on numbers, computations, formulas, and on right answers’.


연구의 목적

The aim of this study is to explore attitudes towards statistics of graduate entry medical students from a variety of backgrounds and focus on understanding the role of prior learning experiences. Understanding attitudes towards statistics on entry to the programme can inform the teaching of the discipline and addressing any issues at the start can help ensure a more positive experience for the students. The results of this study can also help inform those engaged in continuous professional development in medical research on the impact of previous learning experiences on attitudes towards statistics in the future.

Methods

Participants

The participants were enrolled in an exclusively graduate entry medical school in Ireland. All first year students were invited to participate in the study (n = 139). The instrument was distributed to the students in the first weeks of semester prior to any exposure to statistics in the programme to capture their attitudes towards statistics on entry to the programme. Participation was voluntary and anonymous. Ethical approval for this study was granted by the University Faculty Research Ethics committee.

Instrument

Estrada et al. [10] list the 3 most widely used instruments to measure attitudes to statistics: Attitude toward statistics scale (ATS[11]; Statistics Attitude Survey (SAS[12]; Survey of Attitudes Toward Statistics (SATS[13]. Because SATS has been used recently in a study of medical postgraduates [8], it was selected for use in this study to facilitate comparison across studies. The SATS-36 scale was used to measure six attitudes components 

Affect (students’ feelings concerning statistics); 

Cognitive Competence (students’ attitudes about their intellectual knowledge and skills when applied to statistics); 

Value (students’ attitudes about the usefulness, relevance, and worth of statistics in personal and professional life); 

Difficulty (students’ attitudes about the difficulty of statistics as a subject); 

Interest (students’ level of individual interest in statistics); and

 Effort (amount of work the student plans to expend to learn statistics). 


SATS-36[14] is a recent extension of an earlier version of the SATS instrument which originally contained four of the components (Affect, Cognitive Competence, Value and Difficulty). A pre- and post-instruction version of the instrument is available. Given the timing of this survey before any formal statistics instruction in the graduate entry medicine programme, the pre- version of the instrument was used.


Responses to each of the 36 statements were on a scale from 1 (strongly disagree) to 7 (strongly agree). Of the 36 statements, 19 were negatively worded e.g. "I am scared by statistics". Statements which were considered to be negatively worded were reverse coded. A mean of the item responses for each component was obtained to give a measure on a scale of 1 to 7. Higher scores indicate more positive attitudes. Some additional information on demographics, primary degree and prior mathematical achievement were also asked in the survey instrument. Students were asked to rate their performance in mathematics in the past (school or college) on a scale of 1 to 7 where 1 represented very poorly and 7 represented very well. They were asked to give the number of quantitative modules (mathematics or statistics) in their primary degree. Students were also asked to rate their response to "If you had a choice how likely is it that you would have taken any course in statistics" on a scale of 1 to 7 where 1 is not at all likely and 7 is very likely.


Statistical analysis

Cronbach’s alpha was used to measure the internal consistency of responses to all 36 items on the SATS instrument and items on the six components. Cronbach’s alpha was calculated using the reverse coded responses where appropriate. 

Multivariable linear regression was used to predict component scores using demographic variables i.e. age (< 25, ≥ 25), sex, nationality (Irish or non-Irish) and variables representing previous educational experiences: number of quantitative modules taken in their primary degree expressed as a binary variable representing none or one or more, perception of previous performance in mathematics (rated on a scale from 1 to 7). Assumptions underlying the model were tested. 

Spearman’s correlation coefficient was used to measure the strength of the association between rating of previous performance in mathematics, attitude components and the number of quantitative courses taken in their primary degree. All statistical analysis was carried out using IBM SPSS Statistics for Windows Version 20.


Results

Sample characteristics

Of the 139 students in first year, 121 responded to the survey giving a response rate of 87%. 

Internal reliability

Cronbach’s alpha was calculated using responses to all 36 items on SATS and indicated excellent reliability (alpha = 0.93). The reliability of the six components ranged from alpha = 0.79 for Value and Effort, 0.81 for Difficulty, 0.85 for Affect to 0.88 for Cognitive competence and Interest. All values indicated good reliability of the components and were similar to values of alpha reported in other studies [13,15].

Scores on components by demographics and relationship with prior learning experiences

Table  1 gives the mean score for each component, perception of previous performance in mathematics and likelihood of choosing a course in statistics for all students, by demographic groups (age group, gender and nationality) and whether a student had taken a quantitative module in their primary degree. 



Discussion

학생들이 통계학을 어렵다고 생각하는 경향은 있었지만 Zhang et al의 연구에서 보고된 만큼은 아니었음.

While the students in this study tended to perceive statistics as difficult, the perception of difficulty was not as strong as that reported by Zhang et al. [8] for a sample of Chinese medical postgraduates (a mean of 3.4 in this study compared to 2.9), however feelings towards statistics were less positive in our study compared to Zhang et al.’s (mean of 3.7 compared to 4.5). The majority of students in our study had a primary degree in science or a science related subject and had been exposed to quantitative modules (mathematics or statistics) in their primary degree. If the choice to do a course in statistics was theirs, however, only 24% of them described it as likely that they would take the course with 33% stating that it was not at all likely that they would take the course. There may be many reasons for this including a perception that they had already covered the material but this finding has implications for programmes which offer statistics as an option or elective and also for continuous professional development in medical research of which statistics is a critical component.


가장 확실한 예측인자는 과거에 수학과목을 얼마나 잘 했다고 생각하는지였다. 이러한 연관관계에 대해서 통계 교육자들이 좀 더 설명해줄 필요가 있다. 또한 통계학적 사고가 필요로 하는 것이 다르고, 수학과도 서로 다른 특성이 있으므로 이러한 것을 강조하여 학생들이 좀 더 부정적인 생각은 줄이고 열린 마음으로 받아들이도록 도와줄 수도 이씅ㄹ 것이다. 


The strongest predictor of most of the attitude components was how well students felt they had performed in mathematics in the past. This association of past experiences in mathematics with attitudes towards statistics needs to be addressed by statistics educators. Increasingly, statistics is viewed as a separate discipline rather than a subfield of mathematics [17]. Cobb and Moore [18] propose that ‘statistics requires a different kind of thinking, because data are not just numbers, they are numbers with a context’. Statistics did not originate in mathematics and the role of context, variability and data production in statistics differentiates statistical thinking from mathematical thinking. Statistical thinking also relies heavily on interpretation and critical judgement. There is increasing evidence that a strong background in mathematics does not necessarily translate to performance in statistics. Evans [4] demonstrated that students studying statistics in other disciplines such as sociology had more positive attitudes and correct conceptions of statistical fundamentals than mathematics students. Hannigan et al. [15] demonstrated that despite being very mathematically able and confident, a sample of prospective mathematics teachers did no better in an internationally used assessment of conceptual understanding of statistics than students from mostly non-quantitative disciplines. Highlighting the differences between mathematical thinking and statistical thinking may encourage medical students with negative experiences in mathematics in the past and poor perceptions of their ability in mathematics to ‘start afresh’ with statistics and be open to the idea that they will be able to use and understand statistics. Increasingly, statistics educators are encouraged to ground the teaching of statistics in context. Miles et al. [19] suggest that grounding the teaching of statistics in the context of medical research and typical clinical scenarios may better prepare medical students for their subsequent careers. Freeman et al. [3] demonstrated that a multidisciplinary approach to the teaching of medical statistics bringing together a statistician, clinician and educational experts to re-conceptualize the syllabus and placing greater emphasis on applying statistics and interpreting data can bring about better outcomes for students.










 2014 Apr 4;14:70. doi: 10.1186/1472-6920-14-70.

Attitudes towards statistics of graduate entry medical students: the role of prior learning experiences.

Abstract

BACKGROUND:

While statistics is increasingly taught as part of the medical curriculum, it can be an unpopular subject and feedback from studentsindicates that some find it more difficult than other subjects. Understanding attitudes towards statistics on entry to graduate entry medicalprogrammes is particularly important, given that many students may have been exposed to quantitative courses in their previous degree and hence bring preconceptions of their ability and interest to their medical education programme. The aim of this study therefore is to explore, for the first time,attitudes towards statistics of graduate entry medical students from a variety of backgrounds and focus on understanding the role of prior learningexperiences.

METHODS:

121 first year graduate entry medical students completed the Survey of Attitudes toward Statistics instrument together with information on demographics and prior learning experiences.

RESULTS:

Students tended to appreciate the relevance of statistics in their professional life and be prepared to put effort into learning statistics. They had neutral to positive attitudes about their interest in statistics and their intellectual knowledge and skills when applied to it. Their feelings towardsstatistics were slightly less positive e.g. feelings of insecurity, stress, fear and frustration and they tended to view statistics as difficult. Even though 85% of students had taken a quantitative course in the past, only 24% of students described it as likely that they would take any course in statisticsif the choice was theirs. How well students felt they had performed in mathematics in the past was a strong predictor of many of the components ofattitudes.

CONCLUSION:

The teaching of statistics to medical students should start with addressing the association between students' past experiences in mathematics and their attitudes towards statistics and encouraging students to recognise the difference between the two disciplines. Addressing these issues may reduce students' anxiety and perception of difficulty at the start of their learning experience and encourage students to engage withstatistics in their future careers.

PMID:
 
24708762
 
[PubMed - in process] 
Free full text


Interprofessional education in primary care for the elderly: a pilot study

Barth Oeseburg1*, Rudi Hilberts2, Truus A Luten3, Antoinette VM van Etten4, Joris PJ Slaets5 and Petrie F Roodbol1,2





Background

네덜란드의 보건의료시스템은 노령 인구에 대한 의료를 책임질 의사와 간호사 인력과 역량에 대한 문제를 마주하고 있으며, 특히 일차의료 분야에서 심각하다. 여러 parties들은 현재 노령인구들의 복잡한 요구를 다 맞추기에 역량이 부족함을 느끼고 있다. 네덜란드의 고령 인구는 빠르게 증가하고 있고, 95%의 고령 인구는 집에서 홀로 지내면서 GP에게 등록되어 있다. 약 25%의 고령인구는 취약(frail)하다.

The Dutch health care system faces huge challenges with regard to the demand on elderly care and the competencies of nurses and physicians required to meet this demand, especially in primary care. However, the various parties involved (the elderly, professionals, policy makers) feel that the competencies they currently possess are insufficient to meet the increasingly complex needs of the elderly [1-6]. The number of elderly persons (> 65 years) in the Netherlands (total population of about 16.7 million people) is growing rapidly from about 2.5 million to 4.1 million in 2030. In addition, the number of frail elderly is likely to increase between 2010 and 2030 from about 650,000 to over one million [2]. Approximately 95% of the elderly live independently at home and are registered with a general practitioner (GP). In turn, approximately 25% of the elderly who live independently are frail [2].


고령 인구 수가 빠르게 증가하면서, complex care에 대한 요구도 높아지고 있다.

As a consequence of the growing number of elderly, the need for complex care will also increase.


현재 네덜란드의 의료는 질환과 치료에 초점을 맞추고 있으며, 취약한 고령인구는 일상생활과 웰빙에 필요한 요구를 충분히 충족받지 못하고 있다. 따라서 일차의료에 종사하는 의료인력은 질병을 치료하는 패러다임으로부터 건강을 증진하는 패러다임으로 이동해야 한다.

At present, health care in the Netherlands focuses mainly on illness and treatment. In addition, (frail) elderly have expressed unmet needs regarding daily functioning and well-being. Therefore, health care professionals, especially in primary care, will be challenged to a paradigm shift in emphasis from treating illness to promoting health (healthy ageing) [2-6].


취약한 고령층들이 일상생활에 필요한 기능을 할 수 있도록 도와주면서, 비용을 통제하려면 잘 통합된 care system이 필요하다. 이러한 시스템은 다음과 같은 측면을 갖추어야 한다. 

To meet the needs of the (frail) elderly and to optimise their daily functioning and well-being, while at the same time controlling the increasing costs, a well-structured and fully integrated care system is needed. Care should be organised in the desired living environment of the elderly, which, in most cases, will be their own homes. The system needs to focus on the following aspects[7-9]: 

prevention of physical, psychological, and social problems on an individual and group level; 
early detection and comprehensive assessment of physical and psychosocial needs;
the delivery o
f effective care arrangements covering a wide range of health care and community services;
coordination of care and interprofessional cooperation;
ongoing follow-up of the elderly;
productive interaction between the elderly and professionals to empower the elderly to manage and adapt to ageing; and
promoting healthy ageing and well-being.


이상적으로는 GP와 같은 일차의료진과 간호사들이 중추적 역할을 해야 한다. GP는 이미 네덜란드 보건의료시스템에서 gatekeeper의 역할을 하고 있으며, 많은 GP들이 천식이나 COPD같은 만성질환 환자에 대해서 필요한 간호를 위해 간호사를 고용하고 있다. 이러한 환자에 대한 care는 GP와 간호사의 협력과 협조 속에 이루어져야 한다. 그러나 앞서 기술된 것처럼 이들 그룹에 대한 care는 대체로 질병을 치료하는 것에 초점을 두고 있으며, 취약하고 여러가지 질병을 동시에 앓고 있는 고령층의 needs를 잘 맞추지 못하고 있다.

Ideally, primary care professionals, such as GPs and practice nurses (registered nurses or practice assistants with vocational education employed by GPs), should play a central role in the care for the elderly [2,5,6,10]. GPs already play a key role in the Dutch health care system and function as gatekeepers for other community and institutional services. A substantial number of GPs employ practice nurses in their practices, particularly for the care given to chronically ill patients, e.g. patients with diabetes or asthma/COPD. Care to these groups is based on cooperation and coordination between GP and practice nurse and involves shared responsibilities and adequate specifications of responsibilities delegated from GP to practice nurses. However, as mentioned before, the provision of care to these groups is mainly focused on treating illness and does not meet the needs of the (frail) multimorbid elderly [2,3,6-9]. The organisation of the care for complex patients needs to be defragmented in order to meet the new demands [2,4-9].


잘 조직화되고 통합된 일차의료 시스템을 실현시키기 위해서는 전문직의 행동이 바뀌어야 한다. 또한 GP와 간호사의 업무/책임을 재설계해야한다. 그러나 initial education과 secondary education은 이러한 목적에 적합하지 않은데, 그 이유는 이 교육과정이 주로 질병과 관련된 역량에 대한 것이면서, 자기 직종의 역할에 대한 것만 다루고 있기 때문이다. 

전문직의 행동을 변화시키기 위해서는 IPE가 필요하다. 많은 근거들이 IPE를 통해 전문직의 역량을 향상시키고, 궁극적으로 더 나은 환자 outcome을 가져올 수 있다고 보고하고 있다. 그러나 현재 네덜란드의 IPE는 거의 활용되고 있지 않아, 이러한 파일럿 연구를 시작하게 되었다.

To realise a well-structured and fully integrated primary care system, a shift in professional behaviour, particularly in the domains of proactive/preventive care, coordination of care, and communication and cooperation with the elderly and other professionals, is necessary. In addition, a redesign of tasks and responsibilities of GPs and practice nurses is expected to improve the quality of elderly care [2,5-9]. Professional behaviour is inextricably linked to the education of professionals. However, the curricula for initial and secondary education for professionals are not suited to educate professionals in the competencies that are necessary for elderly care, because these curricula focus mainly on disease-related competencies and competencies relevant to their own profession [11-13]. Changing professional behaviour and initiating a fully integrated and well-coordinated provision of elderly care, with shared responsibilities and adequate specifications of delegated responsibilities, requires interprofessional education (IPE) [2,5,6,14]. Evidence indicates that IPE can enhance the competencies of professionals, which will lead to an improvement in the quality of health care and better patient outcomes [15,16]. At present, however, IPE in primary care is rarely utilised in the Netherlands. Therefore, a pilot study was initiated. The aim of this pilot study is to develop an IPE-program for GPs and practice nurses and to evaluate both the feasibility of an IPE program for professionals with different educational levels and the effect such a program will have on the division of their tasks and responsibilities.



Methods

Intervention


기본 접근방법 : Social constructivist approach

An IPE program, based on a social constructivist approach and consisting of four half-day shared sessions, was developed [17]. 

The social constructivist approach emphasises the collaborative nature of learning. Learning is an active process, embedded in social and physical contexts in which learners construct their own competencies based on prior competencies. Cooperation with others creates the opportunity to define or refine learners’ understanding and to create shared understandings with respect to the division of tasks and responsibilities between GPs and practice nurses.


프로그램에서 무엇을 하였는지

During the IPE program, GPs and practice nurses...

prepared themselves for the shared education sessions by reading relevant literature and the GP and 

practice nurse prepared practical assignments based on cases generated from their own local practice

Experts gave short lectures and led the plenary sessions in which the practical assignments were discussed and reflected on.


프로그램의 초안을 전문가가 검토하였음. 프로그램의 목적은 GP와 간호사의 업무와 책임의 변화를 이끌어내기 위한 것.

Draft versions of the IPE program were discussed with expert group (GPs, practice nurses, geriatrician). The educational aim of the program was to realise a shift in tasks and responsibilities from GP to practice nurse.


각 세션의 아웃라인

The following objectives were outlined for the sessions:

Session 1: Vision on elderly care and triage. The aim of this session was: to examine knowledge of and attitudes toward the elderly and elderly care; to explore the use of a comprehensive Web-based triage screening instrument, based on the INTERMED [18-20], the ‘Groningen Frailty Indicator’ [21,22], and the Groningen Well-being Indicator [23]; and to collect data on the medical, psychosocial, and functional capabilities and limitations of all elderly patients in the participating primary care practices.

Session 2: Care plan. The aim of the second session was to develop a comprehensive care plan based on the care plan developed by the Dutch College of General Practitioners [24] and a practical tool to prioritise preferences of the elderly and discuss their medication use, based on Fried et al. [25].

Session 3: Thinking in groups. In this session, elderly patients were empirically categorised into five meaningful segments (primary segmentation) with different health-related needs: vital problems, psychosocial coping problems, physical and mobility problems, problems in multiple domains, and problems caused by extremely frailty. These segments are characterised by the significant relations found with gender, age, frailty, bio-psychosocial complexity, living arrangements, well-being, and preferred decisional control [26]. Segmenting the elderly based on their needs offers GP and practice nurse the possibility to intervene proactively; not only on an individual level but also on a group level. A proactive intervention plan can prevent health problems in the elderly and can help keep chronically ill patients as vital as possible.

Session 4: Reflection and feedback on the IPE program. In this session the final practical assignment (session 3) was discussed and reflected on. In addition, the IPE program was evaluated with the participants and appointments were made for further evaluation.

Participants and procedure

A convenience sample of 10 GPs and 10 practice nurses from eight primary care practices in two provinces in the north of the Netherlands, Groningen and Drenthe, (total population about 1.1 million people) participated. Six primary care practices were informed of the project during a meeting on a transition experiment in elderly care in Groningen in which they participated. Two primary care practices (in Drenthe) were informed by one of the project members and received additional educational materials.

A mixed methods design including quantitative and qualitative methods was used to evaluate the IPE program. The division of tasks and responsibilities of GPs and practice nurses was measured by a VAS scale. The following indicators were measured: 

case finding,
the assessment of medical and psychosocial functioning and recording,
medication,
the development of a comprehensive care plan,
discussion with the elderly on the care plan,
execution of the care plan,
consultation of other professionals in health and community care, and
monitoring the care (plan).

The score on each indicator could range from 0 (tasks and responsibilities of the practice nurse) to 10 (tasks and responsibilities of the GP). For example, a score of score 5 indicated full cooperation between GP and practice nurse. Primary care practices (the GP and practice nurse) were asked to rate the division of tasks and responsibilities before and during the program and to state their future preferences. Four of the eight primary care practices responded.

The quality of the program was measured by a questionnaire developed by the Wenckebach Institute aimed at evaluating educational programs. This questionnaire is based on Kirkpatrick’s model of evaluating training programs [27] and measures the quality of the following indicators: added value of the lectures; clarity, practicability, and added value of the practical assignments; and suitability of the program to facilitate change within practices. The score on each indicator can range from 0 (strongly disagree) to 5 (strongly agree).

In addition to filling in the questionnaire, the participants were asked to report positive features of the program and to give advice on how to improve the program. The response rate was 60% (N = 20). Finally, semi-structured telephone interviews were conducted with primary care practices (GPs and practice nurses) which addressed the following issues: the participants’ expectations with regard to the program; changes in their attitude with regard to elderly and elderly care; suitability of the program to facilitate change within practices; change, or intentions to change tasks and responsibilities of the GP and practice nurse; and advice to improve the program. All the interviews with both GPs and practice nurses were tape-recorded and transcribed. Six out of eight primary care practices responded (response rate 75%). In total, six GP’s and six practice nurses were interviewed.


Analysis

The raw descriptive data of the VAS scale were used to analyse the division of tasks and responsibilities of the primary care practices (N = 4) before and during the program and to list their wishes regarding the division of tasks and responsibilities in the future.

Next, the mean score and standard deviation were calculated for the scores obtained on the Wenckebach Institute’s quality questionnaire. Subsequently, scores for each session [1-3] were calculated. 

Finally, the recorded telephone interviews were transcribed for analysis. Two researchers independently analysed and categorised the data into the themes that structured the interview [28].


Ethical approval

어디에서 자금 지원을 받았으며, 어디에서 ethical review를 받았는가

The project was funded by a grant from ZonMW (The National Care for the Elderly Program: 310300003; The Netherlands Organisation for Health Research and Development) as well as by the University Medical Centre Groningen (UMCG). The study was presented to the ethical review board of the UMCG, which did not find further approval necessary.


Results

Tasks and responsibilities

Table 1. Tasks and responsibilities GPs and practice nurses before, during the program and desirable in the future (N = 4 primary care practices)


Quality of the program

Table 2. Means and standard deviations on the Wenckebach Institute quality of the program questionnaire (N = 12)

Expectation

Despite their willingness to participate in the IPE program, five of the interviewed participants (N = 12) indicated that they did not have any explicit expectations of the IPE program. 

Changes in attitude

Most of the interviewed participants indicated that the IPE program changed their attitudes toward the elderly and care for the elderly. 

Suitability of the program and change within practices

Most of the interviewed participants indicated that the lectures and practical assignments with regard to the triage instrument and the care plan had already initiated a shift in tasks and responsibilities from GP to practice nurse or that there was at least an incentive to realise this shift. 

Advice to improve the program

The participants offered several suggestions for improving the program. 






Conclusion and discussion

The results of this pilot study show that an interprofessional education (IPE) program for professionals with different educational levels, in particular GPs and practice nurses in primary care, is feasible and has an added value to the redefining of tasks and responsibilities.

(...)


전문가 그룹이 긴밀히 협력하여 프로그램을 만들었지만 참가자들의 기대를 완전히 충족시키지는 못하였다. 기간이 너무 짧다거나, IPE프로그램에 대한 정보가 너무 적었다고 하였다.

Despite the fact that the IPE program was developed in close cooperation with expert groups, the program did not entirely meet the expectations of the participants. The length of the program, four half day sessions, was deemed too short to adequately increase the knowledge on, for example, the interpretation of the data generated by the triage instrument. The program was also too short to address the needs of the participants regarding practical tools and evidenced based interventions to handle certain problems in the elderly. Furthermore, participants found the information on the IPE program too concise, and GPs did not inform their practice nurses sufficiently about the program’s content. Indeed, this latter point could have influenced the expectations of the participants and the subsequent success of the program [29].


그러나, 이것은 파일럿 연구이고, 파일럿 연구의 특징은 참여자들이 subject이면서 developer라는 사실이다.

However, this was a pilot study, and one characteristic of a pilot study is that participants are both subjects and developers of the intervention at the same time. The results of this pilot study and the participants’ suggestions for improvement will be used to develop an adapted interprofessional education program for GPs and practice nurses.


Findings in relation to other studies


기존 연구가 많지는 않지만, 부합하는 결과임

To our knowledge, there is a paucity of literature on interprofessional education specifically pertaining to GPs and practice nurses in primary elderly care [31]. Our results are in line with the limited research on interprofessional learning in primary care and reviews on interprofessional education [14,31,32].


Kirkpatrick모델에서 attitude와 performance가 변화하였음

A study by Pearson & Pandya [31], for example, found that primary care professionals value interprofessional education and the sharing of knowledge and expertise. In keeping with a recent review of Reeves et al. [14] on the effectiveness of interprofessional education, our pilot study shows a change in the attitudes of the participants and their performance in practice: level 1 – 2/3 Kirkpatrick’s model [27]. As mentioned above, the impact of the IPE program on the health care system itself and on patient outcomes was not measured in our pilot and could therefore not be compared with findings in other studies.


IPE프로그램이 성공하기 위해서 넘어야 할 장벽들이 있다.

The participants in this pilot study mentioned some barriers to the success of the IPE program. In the literature, other barriers are also mentioned that hinder the implementation of an interprofessional education program. These barriers include...

the social identity of professional groups,
hierarchical relations between professionals,
lack of time,
workload, and
lack of financial incentives for the education program and for interprofessional collaboration in practice. 


In addition, factors related to the implementation and change process of professionals and practices such as...

the support of senior management,
dynamic leadership,
inclusion of all staff members,
a proactive approach to prevent resistance, and
sustaining change during and after the initial implementation process are important [10,30,33-37].


이러한 문제에도 불구하고 전문직종간의 협력은 보건의료시스템에서 대단히 중요하다. IPE와 IP collaboration의 관계가 명확하지는 않지만, 이 관계를 밝히기 위한 노력은 중요하다.

However, despite these start-up problems, collaboration between professionals is crucial in today’s increasingly complex healthcare system. Although the literature indicates that the link between interprofessional education and interprofessional collaboration is not clear, working on clarifying this link is worthwhile [10,38-41]. There is a need for theory-driven development and implementation of interprofessional education programs, combined with high quality research on the effects of interprofessional education. Future research is necessary to learn more about the effects of interprofessional education on an individual level, i.e. how professionals learn in certain settings and why some are more capable than others; as well as its effects on an organisational level, i.e. how factors such as the organisation of care, financial incentives, costs, and patients outcomes influence the health care system [16,30,33,39-41].






 2013 Dec 5;13:161. doi: 10.1186/1472-6920-13-161.

Interprofessional education in primary care for the elderly: a pilot study.

Abstract

BACKGROUND:

The Dutch health care system faces huge challenges with regard to the demand on elderly care and the competencies of nurses and physicians required to meet this demand.At present, the main focus of health care in the Netherlands lies on illness and treatment. However, (frail) elderly need care and support that takes their daily functioning and well-being into consideration as well. Therefore, health care professionals, especially those professionals working in primary care such as GPs and practice nurses, will be challenged to a paradigm shift in emphasis from treating illness to promoting health (healthy ageing). Interprofessional education is necessary to realise this shift in professional behaviour. Evidence indicates that interprofessional education (IPE) can play a pivotal role in enhancing the competencies of professionals in order to provide elderly carethat is both effectively, integrated and well-coordinated. At present, however, IPE in primary care is rarely utilised in the Netherlands. Therefore, the aim of this pilot study was to develop an IPE program for GPs and practice nurses and to evaluate the feasibility of an IPE program for professionals with different educational backgrounds and its effect on the division of professionals' tasks and responsibilities.

METHODS:

Ten GPs and 10 practice nurses from eight primary care practices in two provinces in the north of the Netherlands, Groningen and Drenthe (total population about 1.1 million people), participated in the pilot IPE program. A mixed methods design including quantitative and qualitative methods was used to evaluate the IPE program.

RESULTS:

During the program, tasks and responsibilities, in particular those related to the care plan, shifted from GP to practice nurse. The participants' attitude toward elderly (care) changed and the triage instrument, the practical tool for prioritising preferences of the elderly and discussing their medication use, was considered to have an added value to the development of the care plan.

CONCLUSIONS:

The results of this pilot study show that an interprofessional education program for professionals with different educationalbackgrounds (GPs and practice nurses) is feasible and has an added value to the redefining of tasks and responsibilities among GPs and practice nurses.

PMID:
 
24308766
 
[PubMed - indexed for MEDLINE] 
PMCID:
 
PMC4029384
 
Free PMC Article


Empirical evidence for symbiotic medical education: a comparative analysis of community and tertiary-based programmes

Paul Worley,1 David Prideaux,2 Roger Strasser,3 Anne Magarey4 & Robyn March1





Introduction

지난 20년간 학부 의학교육의 한 부분으로서 지역사회에서 학생교육을 시켜야 한다는 것이 점차 강조되었다. 이러한 것을 가속시킨 몇 가지 요인들이 있다. (국제보건전략, 의료인력, 3차병원의 사례 변화, 의학교육에서 generalism의 중요성)

Over the last 2 decades, there has been an increasing emphasis on students learning in the community as part of their undergraduate medical education. This has been driven by a number of factors, including global health strategies,1 workforce imperatives,2 changing caseloads in tertiary hospitals3 and recognition of the importance of generalism in medical education.4


1997년 Flinders University는 PRCC라는 농촌에서의 general practice를 기본으로 하는 1년짜리 교육과정을 시작하였다. 1년에 최대 16명 학생을 대상으로 (전체 70~90명 학생) 3학년 전체를 애들레이드에서 200~500km 떨어진 농촌에서 진료를 하면서 학습하도록 한 것이다. 나머지 학생은 아델레이드 도심의 3차병원에서 교육을 받는다.

In 1997, Flinders University commenced an innovative year-long clinical curriculum based in rural general practice, the Parallel Rural Community Curriculum (PRCC),5 designed to meet these objectives. The PRCC was funded by a special grant from the Australian Government as part of a comprehensive rural medical workforce strategy.6 It enabled up to 16 students per year, out of a class of 70–90 students, to undertake their entire Year 3 studies within rural practice, 200–500 km from Adelaide. Their peers undertook their Year 3 study at Flinders Medical Centre (FMC), the university's urban tertiary teaching hospital in Adelaide.


의학과3학년은 총 4년의 graduate-entry course 중 임상실습을 하는 2년 중 첫 번째 학년이며, FMC에서는 외과, 내과, 소아과, 여성건강의학, 일차의료(general practice), 정신과학 등을 순차적으로 로테이션 하게 된다. PRCC학생들은 같은 내용을 1년간 지역사회 기반 프로그램을 통해 학습하며, 이 학년이 끝난 후 모든 학생들은 학년말 시험을 치르게 된다.

Year 3 is the first of 2 clinical years in the 4-year graduate-entry course at Flinders University. At FMC it is studied through sequential rotations in surgery, internal medicine, paediatrics, women's health, general practice and liaison psychiatry. The PRCC students study the same content in a year-long community-based programme. At the end of this year, all students sit the final major clinical examination in the course.


PRCC는 다른 문헌에서 더 자세히 다뤄진 바 있으며, 이전 연구에서 PRCC 학생들은 3차병원에서 실습을 한 다른 학생들에 비해서 더 나은 성적을 보여준다는 것이 보여진바 있다. 

The PRCC is described in detail elsewhere.5 It has been previously shown that PRCC students have improved examination performance in comparison with their tertiary hospital-based peers.7 This study was designed to explain the differences in the teaching context, from the students' perspectives, between the tertiary hospital and community-based programmes.




Methods

This study was undertaken from an interpretivist perspective using a case study methodology.8 All 6 students who participated in the PRCC in 1998 were included in the study, along with 16 peers from FMC selected to match for age, gender, and residential and academic backgrounds. Data were collected through structured interviews with the students in weeks 22 and 35 of the 40-week Year 3, with a further interview carried out during the following year. All interviews were tape-recorded, transcribed anonymously, and entered into an electronic database to allow for coding and thematic analysis using nud*ist software. Analysis of the transcripts was undertaken separately by 2 of the authors (PW and RM), with agreement on the findings reached by discussion and by checking with the interviewer (AM) and the students. Final organisation of the findings was based on discussion by all authors. Two authors, PW and DP, were involved in the development of the PRCC programme. At the time of this study, AM and RM were independent research assistants at the School of Medicine at Flinders University, and RS led rural medical education at a separate Australian university.

Data from these 3 sets of interviews are referenced in this article as ‘(Xy.z)’, where ‘X’ refers to the site (R = Riverland, F = FMC), ‘y’ refers to the particular student (1–6 at Riverland, 1–16 at FMC), and ‘z’ refers to the 3 sets of interviews (1 = June 1998, 2 = October 1998, 3 = 1999).


Results

These data describe the teaching/learning environment in which the 3 groups of students undertook their Year 3 study in 1998. Several themes and sub-themes were found within the data (Table 1).



임상 요인 

Clinical factors

This theme related to the success with which the 2 programmes meaningfully integrated the student into the doctor−patient relationship.

참여 및 실습
Participation or practice


‘Okay, it's your patient. What are you going to do?' (R1.2)

‘When I think of diabetes, I can picture this patient that I’ve seen and how we treated them.' (R4.1)


‘I don’t think I've ever been in a situation in which I've had the morals and ethics of my own tested, because … I'm a spectator.' (F12.1)

Importantly, when describing patients, the tertiary-based students never once used the possessive ‘my’ or ‘our’, as described above, but rather referred to ‘a’ or ‘the’ patient(s).


환자와의 접촉 / 동료와의 경쟁
Patient contact or competition with peers


‘…outside of the hierarchical system … whenever anything happens I’m involved, and so I can see a lot more.' (R2.1)

In contrast, the desire to have less competition for patients was a common theme of the tertiary-based students (F12.1, F16.1, F9.1, F13.1, F11.1). One student complained of not having delivered a baby during the entire obstetrics term (F13.1). Students were especially critical of their ward round experience and the inverse relationship between patient load and bedside teaching (F16.1, F4.3).

협력 및 위계 관계
Collegiate or hierarchical supervision

Students commented on the willingness of their teachers to reflect on why they practise as they do. From the following descriptions, there appeared to be a collegiate relationship between the community-based students and their supervisors, compared with a more hierarchical relationship at the tertiary hospital. The intensity of these feelings often took the students by surprise. Interestingly, the more collegiate model appeared to be enjoyed by the supervisors too (R6.1).

A tertiary-based student commented:

‘…some people say, “I always do this,” and then you’ll say, ‘Why?’ and they'll say, ‘Just because I do!”’ (F3.1)

In contrast, a community-based student reported that:

‘…they’re all pretty happy to be – not contested, but challenged, you know. If we've learned something and we say to them, “Why are you doing it that way?” they're quite happy to say, “Well, it's probably not the way you should do it. You'd better do it the right way”.' (R5.1)

A key factor leading to this relationship was the perceived staff : student ratio (R2.1, F16.1). The community programme had fewer students for each designated teacher. This resulted in one community-based student stating:

‘…if you don’t turn up for a day then you get missed here…whereas you can get lost in the hospital system.' (R1.1)

The latter was confirmed by one of the tertiary-based students, who outlined the potential for ‘slacking off’ when there were 10–12 students on a ward round (F13.1). Although some students enjoyed being challenged by consultants, who, at the same time, obviously cared for the students (F9.3), others felt that the consultants treated them as second-rate people just because they happened to be students, and, consequently, most mentoring and teaching occurred with registrars and interns (F3.1, F5.1). In contrast, one community-based student explained that:

‘…basically I try and aim for what the GPs are able to do…I use them as my sort of goal.’ (R2.1)



기관 요인

Institutional factors

Another theme related to how the presence of the students affected the agenda of the two principal institutions involved in the students' learning environment: the local health service's clinical service agenda and the university's academic agenda.


가치있는 역할 또는 불편한 역할
Valued or inconvenient

The ‘participatory’ learning environment in the community-based programme led to a sense of the students feeling valued by staff at the local hospital. One student reported that:

‘…they love us! I think they see us as reasonably valuable assets to the hospital team.’ (R5.1)

This contrasted with the descriptions of inconvenience put forward by the students at the tertiary hospital, which was regarded as an environment that was too busy for teaching (F3.1). These included comments such as students being: ‘supernumerary’ (F5.1); ‘just tagging along with them’ (F11.1); ‘wander[ing] around behind’(F1.1); ‘hanging around theatre where you can’t see a lot' (F9.1); ‘[being] at the bottom of the pile’ (F13.1), and ‘[being] a very small cog in a very large group’ (F13.1).


통합적 학습 또는 블록 학습
Concurrent learning or discipline blocks

The community-based programme was structured so that its students would arrive at the same curriculum end-point as the hospital-based students, but would get there by a different path of study. This study was based on the patients who ‘walked through the door’ of the general practice.

This integrated learning environment appeared to suit certain students, but not others. The students who chose the community-based programme all saw the autonomy and self-directedness that this arrangement fostered as an advantage, but not all found this easy (R3.1) and some expressed anxiety during the year in regard to whether they would end up with substantial gaps in their knowledge (R1.2), or whether they would have their knowledge organised well enough to pass the examinations (R5.3). The tertiary hospital-based students expressed mixed reactions to this, articulating the preference for concentrated discipline-specific learning as a reason for not choosing the community programme (F3.3).


사회 요인

Societal factors

A further theme identified in the data related to how the students' presence was viewed by the community and how students learned to appreciate the wider community needs.


해결의 일부분 또는 문제의 일부분
Part of the solution or part of the problem

The clinical environment in each location was described consistently as strained and understaffed. However, the community-based students recognised themselves as being part of the solution to this problem and had this reinforced by their medical supervisors:

‘…we’re another pair of hands'(R5.1) and ‘…we relieve the load’(R1.1).

One student remarked that their patients shared this view:

‘…the majority of people are really keen for more country doctors…they really see you as a doctor to be…and they just say, “Oh gee, will you come back? Are you going to be a country doctor?”’ (R6.1)

The tertiary hospital-based students, on the other hand, emphasised the extra burden they placed on patients (F16.1) and staff (F3.1, F1.1, F13.1, F4.1). One student summarised their feelings by saying:

‘…students won’t go and examine a patient who we know has been examined 10 times, and we know that we're not helping them.' (F16.1)



지속적 접근 또는 단면적 스냅샵
Longitudinal access or short-term snapshot

The community-based students consulted individual patients repeatedly throughout the year, often at different sites (hospital, clinic, theatre, home) and at different stages of their illness (R1−6.1). This proved to be a powerful personal and professional experience. One student commented:

‘…some of them sort of creep up on you and you get attached to them and then they do something silly like dying…they sort of want you to come and have morning tea or offer you the week on the houseboat, or “When your husband's up can you come for dinner?”' (R5.1)

Sometimes this resulted in patient-initiated contacts, to such an extent that one student reported being double-booked and that they:

‘…actually felt like a doctor…I had to make someone wait 5 minutes.’ (R4.1)

In contrast to these experiences, the tertiary hospital-based students did not once mention continuity, or the importance of understanding a patient's cultural background, during their interviews in Year 3.


개인 요인

Personal factors

The final theme identified brought together data that related to the personal and professional issues learned through their experience.

지속적 멘토 또는 다양한 감독관
Continuity mentors or various supervisors


‘…showing an interest and remembering your name. I think that's one of the big things that really strikes you – if a clinician actually remembers your name from one tutorial to the next and shows an active interest in your learning then it's a lot easier to learn – you're more inclined to learn in that particular setting than if you are just another faceless medical student.'(F6.1)


일 또는 공부
Work or study

In each of their interviews, the community-based students consistently referred to ‘going to work each day’, reflecting a sense of vocation in their day-to-day learning activities (R1−6.1, R1−6.2, R1−6.3). The tertiary students never used the term ‘work’. Instead, they referred to the particular discipline/term they were studying. They described ‘learning’ (F5.1) from doctors, rather than ‘working’ (R1.3) with them.








 2006 Feb;40(2):109-16.

Empirical evidence for symbiotic medical education: a comparative analysis of community and tertiary-basedprogrammes.

Abstract

BACKGROUND:

Flinders University has developed the Parallel Rural Community Curriculum (PRCC), a full year clinical curriculum based in rural general practice in South Australia. The examination performance of students on this course has been shown to be higher than that of their tertiary hospital-based peers.

AIM:

To compare the learning experiences of students in the community-based programme with those of students in the tertiary hospital in order to explain these improved academic outcomes.

METHOD:

A case study was undertaken, using an interpretivist perspective, with 3 structured interviews carried out over 2 academic years with each of 6 students from the community-based programme and 16 students from the tertiary hospital. The taped interviews were transcribed and analysed thematically using NUD*IST software.

RESULTS:

The community-based programme was successful in immersing the students in the clinical environment in a meaningful way. Four key themes were found in the data. These represented clear differences between the experiences of the community-based and hospital-based students. These differences involved: the value that students perceived they were given by supervising doctors and their patients; the extent to which the student's presence realised a synergy between the work of the university and the health service; opportunities for students to meet the aspirations of both the community and government policy, and opportunities for students to learn how professional expectations can mesh with their own personal values.

CONCLUSION:

This study has provided empirical evidence for the importance of the concept of symbiosis in understanding quality in medicaleducation.

PMID:
 
16451237
 
[PubMed - indexed for MEDLINE]


+ Recent posts