18. EU Course CIRAM Risk Analysts V3_PAD version
LIMITED 3. Course design must have a good command of the English language (B2); must have been involved in the development of training for CIRAM risk analysts; must have a minimum 7 years of experience in border management risk analysis; must presently work in a border management risk analysis office in an EU MS or SAC; must have graduated previously from a European Course for CIRAM risk analysts organised by Frontex; should have experience in delivering training for border guards/police if possible (desirable); 3.5.2. Assignment of course evaluators ‘CIRAM’ course assessors are appointed from among existing ‘Eurosur main trainers’. Exceptionally, the main trainers used in one course may also act as assessors for the same course. However, for quality assurance purposes, it is preferable that the course and the learners are evaluated by staff who were not involved in training delivery. ‘CIRAM course assessors’: must prove a good command of the English language (B2); must have been involved in the elaboration of CIRAM-related documents at EU level; must have been continuously involved in the development of training for CIRAM risk analysts; must have a minimum 10 years of experience in border management risk analysis; must presently work in a border management risk analysis office in an EU MS or SAC; must have acted as CIRAM main trainer in at least one European course for CIRAM risk analysts; should be a member of FRAN if possible (desirable). 3.6. Tests and weighting The certification session includes three tests: the knowledge test (to assess whether the theoretical concepts are mastered), a practical test (to ensure the learner is able to use their own analytical capability and own creativity in order to deliver CIRAM-based analytical products) and an analytical test (to 41
LIMITED Frontex European course for CIRAM risk analysts assess whether the learner is able to evaluate and report on the quality of a risk analysis product). Tests are simultaneously evaluated by five course assessors. 3.6.1. Knowledge test This is based on points. There are 40 questions (multiple choice), each ques- tion having 0.5 points allocated for the correct answer (20 points maximum). A minimum of 10.00 points are required to pass the test. Allocated time is 50 minutes. The test is performed online under the direct supervision of the training team. The learner receives the feedback as soon as the test results are submitted. The test cannot be repeated within the same assessment session. 3.6.2. Practical test This is based on points. It consists in the development of a risk analysis prod- uct (including methodology), based on a set of documents provided by the assessment team. The allotted time for the test is 180 minutes. The test is performed (in writing) under the direct supervision of the assessment team. The maximum number of points is 20.00. A minimum of 10.00 points are re- quired to pass the test. Points are granted individually by each assessor for each evaluation item, and they are cross-checked afterwards. Each sub-item may be marked from 0 to 1 point in five steps (0.00, 0.25, 0.50, 0.75, 1.00) based on a common evalua- tion file. The acceptable difference between the points granted by assessors for the same evaluation sub-item is 0.25 points. The acceptable difference be- tween the points granted by assessors for the same evaluation item is 0.50 points. The acceptable difference between the total points granted by asses- sors for the test is 1.0 point. In the case where the difference between assessors is bigger than the accepta- ble difference, negotiations are carried out until the difference is clarified. If no agreement is reached, the sub-items of assessors are both reduced automat- ically to their average until balance is established. The learner receives feed- back/results from the assessment team at the end of the certification session. 3.6.3. Analytical test This is based on points. It consists of the critical analysis of a risk analysis prod- uct (oral). Allotted time for the test: 35 minutes (10 minutes are allotted to study 42
LIMITED 3. Course design the case and 25 minutes for presentation and interview). The test is performed under the direct supervision of the assessment team. The maximum number of points is 20.00. A minimum of 10.00 points are required to pass the test. Points are granted individually by each assessor for each evaluation item, and they are cross-checked afterwards. Each sub-item may be marked from 0 to 1 point in five steps (0.00, 0.25, 0.50, 0.75, 1.00) based on a common evalua- tion file. Exceptions are the ‘CIRAM-based analysis’ sub-items marked from 0 to 2 points in five steps (0.00, 0.50, 1.00, 1.50, 2.00). The acceptable difference between the points granted by assessors for the same evaluation sub-item is 0.25 points (0.50 points in the case of ‘CIRAM‑based analysis’ sub-items). The acceptable difference between the points granted by assessors for the same evaluation item is 0.50 points. The acceptable difference between the total points granted by assessors for the test is 1.0 point. In the case where the difference between assessors is bigger than the accepta- ble difference, negotiations are carried out until the difference is clarified. If no agreement is reached, the sub-items of assessors are both reduced automat- ically to their average until balance is established. The learner receives feed- back/results from the assessment team at the end of the certification session. 3.6.4. Final grade In order to be certified as a CIRAM risk analyst the learner must pass all tests foreseen. In case of failure, the certification session is resumed with the pos- sibility for resit during the next certification session. Such procedure does not involve repeating the course. The learner will be re-examined only in connec- tion with the failed test(s). The final grade is calculated as follows: 54.00 points or more and no failed tests or tests graded as ‘satisfactory’: ‘outstanding’ 43.00 to 53.99 points and no failed tests: ‘good’ 36.00 to 42.99 points and no failed tests: ‘satisfactory’ 35.99 points or less (or/and failed tests): ‘not-compliant’ (failed) Final grade shall be mentioned in the graduation paper. 43
LIMITED Frontex European course for CIRAM risk analysts 3.6.5. Final grade chart OUTSTANDING All tests graded as ‘GOOD’ or ‘OUTSTANDING’ and minimum 54.00 points achieved GOOD All tests passed and minimum 43.00 points achieved SATISFACTORY All tests passed and minimum 36.00 points achieved NON-COMPLIANT Test(s) is(are) failed or all tests are passed but the overall points achieved is 35.99 points or below 3.6.6. Assessment methods Test/method Type Weighting Knowledge test (online) Summative 32.25 % Practical test (product development) Summative 32.25 % Analytical test (product critical analysis) Summative 32.25 % Save points (interim evaluations/thesis) Summative 3.25 % 3.6.7. Resit procedure As a resit procedure, in case of failure, the learner will be re-examined at the end of the next course which generally means 6 to 12 months later. Exception- ally, if the assessment team consider as feasible and the learner agrees, re- assessment can be done at the end of the same assessment session. In such case, the learner will lose the right to join the initially planned (official) re-ex- amination session (6 to 12 months later). During resit, the maximum grade to be obtained is ‘satisfactory’. 3.6.8. Course theses Learners are invited to elaborate (in groups of two or individually) a thesis (20–25 pages) on a specific subject (risk analysis related). The subjects are es- tablished at the end of Module II. Following the analysis by the course manage- ment team, Frontex Training Unit may publish the most relevant theses with the support of EC (OPOCE). For every thesis marked by the course manage- ment team as ‘considered to be published’, (up to) 1.00 save point is granted to contributor(s). The point can be used during the official assessment session in any of the planned tests, as needed by the learner. 44
LIMITED 3. Course design 3.6.9. Save points policy At the start of each centralised module, an interim evaluation is performed (online test). The results of the interim assessments, together with the results of the entry test, are converted up to a maximum of 1 point that can be used during the official assessment session, in any of the planned tests, as needed by the learner (sample calculation: 35 % obtained on the first test + 55 % ob- tained on the second test + 90 % obtained on the third test. Overall average: 60 %. Converted to save points: 0.60 points to be used by the learner in the official assessment session. If we include also the 1.00 save point related to the thesis, a maximum of 2.00 save points can be earned during the course, and these can be used by the learner during the official assessment session. 3.6.10. Selection for the pool of CIRAM main trainers Based on the results obtained (minimum ‘good’) the CIRAM course assessors may select certified CIRAM risk analysts to be taken on board as CIRAM main trainers during any of the future courses. Selected candidates will be asked to complete the train the trainer’s course delivered by Frontex Training Unit. 3.6.11. Calculation of credit points Hours Approximate Calculation of ECTS MI M II M III M IV MV Total (certification) Hours Lecture - 16.00 6.00 7.50 - 29.50 Seminars - 9.00 12.00 10.50 - 31.50 Tutorial (individual training plans) - - 3.00 9.50 - 12.50 Other (daily debriefings) - 2.50 1.00 1.00 8.00 12.50 Assessment 1.00 - 1.00 1.00 23.00 26.00 Revisions - 3.00 7.50 1.00 - 11.50 Experiential 30.00 20.00 20.00 20.00 - 90.00 Total Learning Hours 31.00 50.50 50.50 50.50 31.00 213.50 ECTS (credit points) 9 45
LIMITED Frontex European course for CIRAM risk analysts 3.7. Module I design: entry module 3.7.1. Knowledge K To explain the meaning of risk analysis generally and the meaning of 4 integrated border management risk analysis particularly, including the role of CIRAM K To connect the concept of integrated border management risk analysis 4 to various legal provisions in force at EU level K To outline the need to use risk analysis in border management and the 4 importance of a common risk analysis model at EU level SQF LO: Outline a defined range of national, EU and international law, policies, rules and 4 procedures relevant to integrated border management activities. 3.7.2. SQF level Majority of learning outcomes described as level 4. Overall module level: 4 4 3.7.3. Learning strategy Learning strategy considers online delivery of the module, as self-study. Content of the module is made available, via Frontex Virtual Aula, to all po- tential candidates. Future or actual staff working in border management risk analysis offices may enrol online to the entry module following communica- tion with national authorities, as soon as the course is officially declared open. There is no fixed limit in relation to the number of candidates enrolled by each Member State to the entry module. Access to the entry module is granted to all candidates at the same date. Specific ma- terials are available for self-study. However, all materials available under the course platform – at the moment of receiving access to the entry module – shall be treated as supporting materials for the entry exam. The registration period has a duration of 5 weeks. The allocated time granted to study the materials for entry exam is 6 weeks. The entry exam is carried out online, at the same time with all registered learners. A simulation exam is conducted usually 3 weeks in advance in or- der to check if technical specifications required by the platform are met by all stations to be used during the official entry exam. The exam date is commu- nicated in advance to all learners while the exact hour is decided following a 46
LIMITED 3. Course design questionnaire addressed to all enrolled candidates. The exam has 40 questions (multiple choice) and 50 minutes allocated. The result is revealed to the can- didate immediately after the test, based on the number of points achieved, as ‘shortlisted’ or ‘not shortlisted’. A minimum of 50 % from the total number of points must be achieved in order to be shortlisted. Admission to the course is granted to the candidates that have passed the test, within the limit of available seats (one – exceptionally two candidates per state), based on the result obtained (e.g. if only 15 seats are available, the first 15 candidates in the order of merit will be accepted provided that they are from different states and all of them reached the minimum number of points fore- seen). In case no candidates from a certain state reach the minimum number of points foreseen, the seat is released and may be occupied by a second can- didate from another state (order of merit). In case the balance per participat- ing state is considerably affected following the entry test results, the course management team reserves the right to change the required number of points for admission to 40 %. In case two candidates from the same state have the same score, seconding state will be asked to decide on the final candidate, un- less extra seats can be arranged by Frontex Training Unit. 3.8. Module II design: Basics of risk analysis 3.8.1. Knowledge K To explain the essential role of the intelligence cycle in the field of risk 5 analysis K To justify the broad use of intelligence cycle by the law enforcement 5 community K To describe the intelligence cycle, its elements and concisely the 5 procedures that each element introduces K To describe the analytical tools and techniques that can be used within 5 the scope of risk analysis SQF LO: Describe a defined range of national, EU and international law, policies, rules and 5 procedures relevant to border guarding activities. 47
LIMITED Frontex European course for CIRAM risk analysts 3.8.2. Skills S To evaluate sources and information that could be exploited within the 5 scope of risk analysis S To make use of tasking and be able to collect, evaluate, collate, analyse, 5 interpret, report, disseminate and review information S To implement intelligence cycle in the scope of risk analysis 5 S To make use of analytical tools, techniques and services when developing 5 analytical products SQF LO: Apply specialised knowledge and skills in border guarding areas that require 5 specialised professional competences. 3.8.3. Competences C To ensure the reliability, integrity and validity of information collected for 5 risk analysis SQF LO: Ensure implementation of specialised knowledge and skills in border guarding areas 5 that require specialised professional competences. 3.8.4. SQF level Majority of learning outcomes described as level 5. Overall module level: 5 5 3.8.5. Learning strategy Learning strategy considers 5 days of seminars in connection to the entry exam topics and specialised sessions focusing on the intelligence cycle, its elements together with analytical tools, techniques and services. An experiential learn- ing stage at home with a minimum duration of 20 hours before joining mod- ule III is required. Module II includes lectures, seminars and debates moderated by trainers. The learning process is expected to take place around questions and study cases discussed in plenary sessions. Simulation of the competence test is planned to be carried out at the end of the module. Also, at the end of Module II, learners may propose/select the thesis topic. 48
LIMITED 3. Course design 3.9. Module III design: Models of risk analysis 3.9.1. Knowledge K To describe the main risk analysis concepts in line with CIRAM 5 K To describe threats, vulnerabilities, impact and risks 5 SQF LO: Describe a defined range of national, EU and international law, policies, rules and 5 procedures relevant to border guarding activities. 3.9.2. Skills S To perform CIRAM-based risk analysis 5 S To identify threats, vulnerabilities, impact and risks 5 S To measure threats, vulnerabilities, impact and rate/level risks 5 SQF LO: Apply specialised knowledge and skills in border guarding areas that require 5 specialised professional competences. 3.9.3. Competences C To recommend measures in relation to the identified risks 5 SQF LO: Ensures that CIRAM risk analysts integrate and promote security policies. 5 3.9.4. SQF level Majority of learning outcomes described as level 5. Overall module level: 5 5 3.9.5. Learning strategy Learning strategy considers 5 days of seminars and debates in connection to the Common Risk Analysis Model and its elements. Experiential learning stage at home with a minimum duration of 20 hours before joining Module IV is re- quired. Module III seminars and debates are moderated by trainers. The learn- ing process is expected to take place around questions, role plays and study cases discussed in plenary sessions. Simulation of the practical test is planned to be carried out at the end of the module. Also, at the end of Module III, learn- ers may propose the structure of their thesis. 49
LIMITED Frontex European course for CIRAM risk analysts 3.10. Module IV design: applied risk analysis 3.10.1. Knowledge K To describe the concept and the scope of analytical products including 5 their classification K To describe the design principles and protocols to be taken into account 5 when drafting analytical products K To describe the writing styles and techniques to be used depending on the 5 given context SQF Describe a defined range of national, EU and international law, policies, rules and 5 LO: procedures relevant to border guarding activities. 3.10.2. Skills S To elaborate (tailored) analytical products within the scope of integrated 5 border management following the organisational needs and the operational situations S To present analytical products, within the scope of integrated border 5 management, to operational or managerial staff SQF LO: Apply specialised knowledge and skills in border guarding areas that require 5 specialised professional competences. 3.10.3 Competences C To ensure the quality of analytical products within the scope of integrated 5 border management, presented to operational or managerial staff, as a basis for decision making SQF LO: Ensures that CIRAM risk analysts integrate and promote security policies. 3.10.4. SQF level Majority of learning outcomes described as level 5. Overall module level: 5 5 3.10.5. Learning strategy Learning strategy considers a mix of sessions that must be delivered in or- der to enable the learner to develop analytical products, following the rules/ practices gained during the first three modules. Module includes lectures, 50
