Search results

Through the perspectives of a project director/principal investigator and external evaluator, this chapter explores the methods, strategies, and processes used to design and conduct ongoing, comprehensive evaluation of the Math and Science Teacher Initiatives at California State University, Dominguez Hills. Initiatives include an undergraduate program for students interested in STEM teaching careers, multiple alternative route programs to teacher certification in math and science and a fellowship program for master science teachers. Using a collaborative evaluation framework (O’Sullivan, 2004), the authors highlight the benefits of conducting multiprogram evaluation from a collaborative lens and describe the systematic processes used to engage stakeholders, from the design phase of the evaluation through data collection, analysis, and reporting of participant impact and outcomes. The strengths of the program and evaluation approach, along with specific strategies and methods utilized, will be explored. The chapter will conclude with challenges, lessons learned, and best practices, as well as implications for the field of teacher education and leadership within a STEM context.

The European Union (EU) Medical Device Regulations (MDR) 2017/745 entered into force on May 2021 with changes related to strengthening the clinical evaluation requirements, particularly for high-risk devices. This study aims to investigate the impact of these strengthened requirements on medical device manufacturers by investigating the challenges they encounter while generating an MDR-compliant clinical evaluation report.

A systematic literature review was carried out using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses method of peer-reviewed literature and various government jurisdictional reports and legislation.

The findings from the study understanding what constitutes sufficient clinical evidence poses the biggest challenge to the generation of an MDR-compliant clinical evaluation report. Resulting from the challenges they are facing, manufacturers of certain CE-marked medical devices are planning to remove (and have removed) devices from the EU market upon expiration of their certificate, and in the case of new and innovative devices, some manufacturers are planning to launch in other markets ahead of the EU. These challenges will lead to a potential shortage of certain medical devices in the EU and a delay in access to new devices, thereby negatively impacting patients’ quality of life.

This study provides a unique insight into the challenges currently experienced by medical device manufacturers as they transition to the MDR clinical evaluation requirements and the subsequent impact on the continued availability of medical devices in the EU. A limitation is the lack of literature analysing the regulations and their effects.

This study has both theoretical contributions in that, to the best of the authors’ knowledge, it is the first detailed and systematic review of the new MDR Regulations and has implications for practice as manufacturers and policymakers can leverage it alike to understand the challenges of the new MDR.

The main aim of this paper is to establish a reasonable and scientific evaluation index system to assess the high quality and full employment (HQaFE).

This paper uses a novel Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) multi-criteria framework to evaluate the quality and quantity of employment, wherein the integrated weights of attributes are determined by the combined the Criteria Importance Through Inter-criteria Correlation (CRITIC) and entropy approaches.

Firstly, the gap in the Yangtze River Delta in employment quality is narrowing year by year; secondly, employment skills as well as employment supply and demand are the primary indicators that determine the HQaFE; finally, the evaluation scores are clearly hierarchical, in the order of Shanghai, Jiangsu, Zhejiang and Anhui.

A scientific and reasonable evaluation index system is constructed. A novel CRITIC-entropy-TOPSIS evaluation is proposed to make the results more objective. Some policy recommendations that can promote the achievement of HQaFE are proposed.

Since the present university leading cadre capability evaluations are mainly static, there is a lack of evaluation methods to address dynamic and multi‐scale‐based situations. Some important factors to address people's performances, such as the developing trends and potentialities are considered. The purpose of this paper is to attempt to propose a dynamic evaluation model based on multivariate delay connection number.

First, evaluation results of previous periods are taken into the current period and values of uncertain numbers are revised. Next, a dynamic evaluation model is built for university leading cadre. Last, a numerical example is used to prove its feasibility and effectiveness.

This paper promotes a corrected equal portion value method of uncertain numbers i1(τ), … ,in(τ) from the adjacent two periods to multi periods, and builds a dynamic evaluation model, which proved simple‐structured and easy to apply.

The new model is applied in the evaluation of university leading cadre, and could give a more comprehensive, dynamic, scientific analysis for evaluation by model application.

The paper develops a novel evaluation model based on a multivariate delay connection number, which expands traditional methods from a static situation to a dynamic and multi‐scale‐based situation.

The evaluation of maintenance tenders is a task that involves not only consideration of the prices offered, but the financial and technical expertise of the tenderers as well. The evaluations can be highly complicated and lengthy when dealing with large projects and numerous tenderers. Presents an evaluation methodology in the form of a tabular procedure to be used by the evaluators of maintenance contracts. Develops seven tables to provide quantitative values for the submitted tenders. The first five tables are designed to evaluate the technical efficiency of the tenderers, while the sixth table is designed for the final evaluation including prices. In the first table, the tender compliance as per the requirement of the tender document is evaluated. Uses the second table to evaluate the support and maintenance plan. The third table presents an evaluation of the experience and the financial status of the tenderer. The fourth and fifth tables are used to evaluate the tenderer’s staffing proposal and how it is related to the requirements of the project. The sixth table summarizes the evaluation of the previous four tables for each evaluator. The seventh table illustrates the final evaluation of each tenderer, and hence a decision could be made. By adding the average technical score of each tenderer to his price score, the evaluator can easily rate each tenderer’s ability to carry out the work rather than depending only on price, which might not always mean a good choice.

The purpose of this paper is to characterize performance evaluation dynamics developed in Lisbon Municipal Libraries Network (LMLN) over a two-decade period (1989-2009), using a specific model and tools of (meta-)analysis.

Based on a methodology eminently qualitative supported by a combination of research methods (literature review, construction and application of conceptual models for analysis and case study), the author examined LMLN's performance evaluation progress, focusing on the diachronic study of evaluative processes – the performance evaluation dynamics.

Between 1989 and 2009, LMLN developed four main performance evaluation dynamics. The most significant results that emerged from the examination of these dynamics relate to the following elements of the model of analysis Dynamics and Impacts of Library Performance Evaluation (DILPE): evaluation objects and methods; organization; and dissemination of results. The study also emphasized the importance of some factors to dynamics sustainability: the presence of a permanent coordination team, in the direct dependency of the head of library services, with the right competences; the existence of a culture of assessment; and the commitment of leadership with performance evaluation.

The meta-evaluative approach and particularly the focus on the long-term development of evaluative theories and practices, contributes to the enlargement of the international corpus on library performance evaluation. On the other hand, the analytical model and conceptual tools created might be useful to other researchers/practitioners willing to meta-evaluate library performance evaluation dynamics.

Introduces a method of food sensory evaluation employing artificial neural networks. The process of food sensory evaluation can be viewed as a multi‐input and multi‐output (MIMO) system in which food composition serves as the input and human food evaluation as the output. It has proved to be very difficult to establish a mathematical model of this system; however, a series of samples have been obtained through experiments, each of which comprises input and output data. On the basis of these sample data, applies the back‐propagation algorithm (BP algorithm) to “train” a three‐layer feed‐forward network. The result is a neural network that can successfully imitate the food sensory evaluation of the evaluation panel. This method can also be applied in other fields such as food composition optimizing, new product development and market evaluation and investigation.

Performance measurement and programme evaluation have been promoted as a central mechanism of recent Australian public sector (APS) reform. Outlines recent reforms in the APS and identifies links between evaluation and performance information. Identifies the major issue of credibility, when performance information is produced internally and not verified externally. A lack of performance systems and standards can create difficulties for both internal and external programme evaluations. Concludes that: reforms introduced to evaluate performance in the APS were promoted with high expectations which have only partially been fulfilled; the present system is internally focused with a narrow role for evaluation and a lack of credibility because of the independence issue; the present systems associated with the performance approach and its evaluation are not providing enough information to deal with the tough questions of the effectiveness of government programmes. Proposes that a middle ground between internal and external programme evaluation strategies be adopted. This allows the strengths of internal evaluation to be retained. At the same time, it allows the possibility of improving programme evaluation by adding external independent verification and an extended effectiveness role.

Constructing livable eco-civilized cities has become one of the important tasks of the reasonable planning of urban development. The construction of an ecological city aims to achieve the harmonious coexistence of society, resource, and environment. However, the current evaluation method system of an ecological building encounters problems from a defective evaluation index. Hence, a relatively perfect evaluation index system is built. First, the analytic network process (ANP) is combined with the existing standards online. Then, a rapid calculation of the index weight is performed using Super Decisions software. Based on the needs of complicated problems, the classical TOPSIS model algorithm is improved by introducing the weight coefficient; this improved TOPSIS algorithm is then taken as the core to build a whole set of comprehensive evaluation method system for ecological buildings. The ecological urban agglomeration in Qinling Mountains of Xi’an is used in this study as the example to perform verification in practice. Contrastive analysis is performed on the evaluation results of the new and old buildings using this method system; the results indicate that the ecological effect of the buildings in the new area is much better than that of buildings in the old area. These results are mostly consistent with the evaluation results given by the expert group. Thus, the comprehensive evaluation system proposed in this article is reliable, and effective, as well as practical to some extent. This method can be used in a wider range of building evaluation and further improved in future studies.

The feasibility of using job evaluation procedures to establish non‐biased pay structure is a central issue in the debate over comparable worth. Results of two investigations indicate that even under carefully controlled conditions job evaluation results are highly susceptible to random and systematic errors on the part of the evaluators, and are apt to vary significantly from the concept of worth underlying the evaluation plan. The choice of evaluation instruments or scoring procedure can also have a major impact on results. Thus, the feasibility of using job evaluation results as the governing criterion of the relative worth of jobs is highly questionable.