Introduction. Manikin-based studies for evaluation of ventilation performance show high heterogeneity in the analysis and experimental methods used as we pointed out in previous studies. In this work, we aim to evaluate these potential limitations and propose a new analysis methodology to reliably assess ventilation performance. Methods. One hundred forty healthcare providers were selected to ventilate a manikin with two adult self-inflating bags in random order. Ventilation parameters were analysed using different published analysis methods compared to ours. Results. Using different methods impacts the evaluation of ventilation efficiency which ranges from 0% to 45.71%. Our new method proved relevant and showed that all professionals tend to cause hyperventilation and revealed a significant relationship between professional category, grip strength of the hand keeping the mask, and ventilation performance (p = 0.0049 and p = 0.0297, resp.). Conclusion. Using adequate analysis methods is crucial to avoid many biases. Extrapolations to humans still have to be taken with caution as many factors impact the evaluation of ventilation performance. Healthcare professionals tend to cause hyperventilation with current devices. We believe this problem could be prevented by implementing monitoring tools in order to give direct feedback to healthcare professionals regarding ventilation efficiency and ventilatory parameter values.