Skip to main content

The association between manual handling operations and pain in the hands and arms in the context of the 2018 BIBB/BAuA Employment Survey

Abstract

Background

Manual handling operations (MHO) are tasks performed by hand that require repetitive and forceful hand and arm movements. MHO are currently performed in many workplaces in skilled and unskilled jobs in the production and service sectors. MHO are considered as work-related health risk factors. The relationship between MHO and the occurrence of disorders of the upper extremities has been established. MHO can cause diseases such as tenosynovitis or carpal tunnel syndrome. This study aims to assess the current prevalence of MHO in the German workforce and to evaluate the relationship between MHO and the occurrence of hand and arm complaints.

Methods

The analysis was based on the German 2018 BIBB/BAuA Employment Survey. For this analysis we included subjects aged between 16 and 66 who work at least 35 h per week. The self-reported frequency of MHO (never; rarely; sometimes; often) was considered as the exposure of interest and was stratified by gender and occupation. Prevalence ratios (PR) were used to report the relationship between MHO and self-reported pain in the hands and arms (robust log-linear Poisson regression). Adjustments were made for age, gender, actual weekly working hours, psychosocial workload, and other physical workloads. The regression analyses considered complete cases.

Results

The analyses included 14,299 employees. Frequent MHO were reported by 32.6% of men and 31.1% of women. These workloads were often reported by respondents who work in the agricultural sector (men: 70.1%; women: 79.0%), in unskilled (men: 59.4%; women: 66.9%), and skilled manual occupations (men: 72.7%; women: 66.7%).

A higher frequency of self-reported MHO was associated with a higher prevalence of hand complaints (PR 2.26 CI 2.00–2.55 “often” vs. “never” = ref.) as well as arm pain (PR 1.73 CI 1.55–1.92 for “often” vs. “never” = ref.).

Conclusion

MHO are still frequent in many occupations. The shown association between MHO and pain in the hands and arms demonstrates the importance of MHO in the current German workforce and the necessity to further develop prevention strategies.

Peer Review reports

Background

The relationship between work-related manual handling operations (MHO) and the occurrence of musculoskeletal disorders in the hands and forearms is well established [1,2,3]. However, the literature does not provide a unique definition of MHO. Typically, MHO are described as tasks performed by hand, which includes work activities that demand manual skills; highly repetitive sequences of hand and arm movement; and/or operations that require high degrees of hand and arm force [4]. MHO are characterized by a repetitive as well as static strain of the muscles and ligamental structures. The strain these tasks place on the body depends on the intensity of the required effort, the range of motion as well as the duration and frequency of the movements. MHO is a common physical workload among the European and German working population. In 2017, Eurofound conducted the sixth European Working Conditions Survey [5], which reported that 33% of women and 30% of men surveyed answered that performing MHO is a major part of every working day. A similar percentage stated that MHO made up 25 to 75% of their working time.

The European Agency for Safety and Health at Work (EU-OSHA) reported that between 61 and 63% of employees were exposed to repetitive hand or arm movements for at least a quarter of their working time across the EU-28 states between 2005 and 2015 [6]. In Germany, data on MHO are collected regularly through the BIBB/BAuA Employment Surveys. Conducted every 6 to 7 years, these surveys aim to collect data on the working population to map the current working situation in Germany. For this purpose, data is collected on vocational training and education, working conditions, health conditions, and complaints. Asked about manual handling operations during the 2012 BIBB/BAuA Employment Survey, 43.5% of men and 40.5% of women responded that they often perform manual work, which includes manual skills, high sequences of movement, and operations that require a high degree of force [7]. On the other hand, 13.8% of men and 18.8% of women responded that they "often" experienced pain in their hands during or after work.

A high degree of repetitive strain to the hand-arm system can cause degenerative structural changes in the muscles and tendons of the arms and hands, and may lead to specific diseases, for example carpal tunnel syndrome (CTS) [1,2,3, 8, 9]. Disorders such as CTS and tendonitis of the forearms that are caused by work-related, repetitive MHO are recognized as occupational diseases by law in Germany as well as in other countries. In this context, the German statutory accident insurance approved CTS as an occupational disease in 304 out of 1033 cases in 2018 [6, 10].

The etiology of musculoskeletal disorders is considered to be multifactorial [11]. Such other factors besides MHO are related to disorders, complaints, or pain in the hands and arms. There is evidence that other types of physical workload, such as the manual lifting of heavy loads [1,2,3, 8], and overhead work [1, 9], are risk factors for disorders in the hands and forearms. Furthermore, it has been shown that MHO are also related to physical exposures such as hand-arm vibrations [1, 2, 8], and climatic aspects [12,13,14,15]. Individual factors, including age [3, 16], gender [17, 18], being overweight [16, 19, 20], and the patient’s smoking behavior [21], are also described as risk factors for pain in the hands and arms. In some cases, psychosocial factors [8, 22], and the socioeconomic status [23, 24] have also been shown to be related to musculoskeletal disorders of the hands and arms.

The continuous change of current workplaces and the high numbers of employees who perform MHO demand that we provide updated information on the distribution, the impact and the consequences of MHO to the health of employees in today’s workplaces. Therefore, this study aimed to describe the self-reported prevalence of exposure to manual handling operations in the current German workforce based on the 2018 BIBB/BAuA Employment Survey and to investigate the relationship between the intensity of manual handling operations and the prevalence of pain in the hands and arms to estimate the current percentage of pain prevalence attributable to MHO.

Methods

Study design and study population

The study was part of the F2456 project of the German Federal Institute for Occupational Safety and Health (BAuA). The study is a secondary analysis using the data of the 2018 BIBB/BAuA Employment Survey with an emphasis on exposure to physical workloads and its association to musculoskeletal disorders. The 2018 BIBB/BAuA Employment Survey was based on telephone interviews and used a cross-sectional study design. German-speaking people aged 15 and older who work more than 10 h per week were included in the survey [25]. BAuA entrusted social research company Kantar Public with the conduct of standardized telephone interviews between October 2017 and April 2018. The sampling strategy of the survey used a dual frame sampling approach, which included landline and cell phone numbers to reach a wide range of participants. To increase the availability of the employees, the interviews were mainly conducted in the afternoons, evenings, and on weekends. The survey covered several confounders such as age, gender, and key aspects of social-economic status. Other epidemiologically relevant facts, including smoking behavior, body weight, and height, were not part of the questionnaire and could therefore not be used. Overall, 20,012 employees were interviewed and included in the 2018 BIBB/BAuA Employment Survey.

For this paper, the study population was reduced to persons of working age aged < 67 years who work in fulltime jobs (normal working hours of 35 h per week or more). No minors below the age of 16 years were included.

Response variables: hand and arm pain

Employees were asked about the occurrence of a range of pains and complaints related to or experienced after work, in different regions of the musculoskeletal system that occurred within the past 12 months, with possible answers being “yes” and “no”. The answers relating to hand and arm pain were used as separate outcomes of interest.

Explanatory variables: manual handling operations and covariates

Furthermore, participants were asked about different aspects of their current working conditions. The frequency of manual handling operations was assessed via the following question: “Do you perform work with your hands that includes intensive manual work, fast sequences of movement, or requires high levels of force?” (Author’s translation). Participants could give one of four categories as a response, namely “never”, “rarely”, “sometimes” or “often”. If respondents refused to answer, this was treated as a missing answer and was excluded from the analysis.

The question regarding the manual lifting of heavy loads was different for men and women with respect to the absolute weight of the load lifted (men: 20 kg or more; women: 10 kg or more). Other physical exposures at the workplace were examined in a similar manner to MHO; only “overhead work” was indirectly derived and used in the regression models as a binary dummy variable. This variable was generated based on the answers related to the frequency of work performed in awkward body postures. Similar to the manual lifting of loads, employees were asked to state whether their work required them to “never”, “rarely”, “sometimes” or “often” work in awkward postures such as bending, working overhead, or kneeling or squatting. If interviewees answered “often”, they were subsequently asked in which of these awkward postures they often worked. A binary dummy variable was then developed from the combination of these answers (often working overhead: “yes” or “no”). Important confounders such as age (years) and gender (men; women) were surveyed at the beginning of the interview. Actual working time per week (hours) included overtime, extra work, and on-call service. Working hours in other part-time jobs were not considered.

To assess the psychosocial workload, a score was calculated based on the Kroll index [26]. This index represents the psychosocial workload of employees and considers different psychosocial aspects, which were covered in the 2018 BIBB/BAuA Employment Survey. Subcategories of the psychosocial workload index include psychological stress, social burdens, and temporal involvement. These sub-indices were calculated by totaling the points of the corresponding single items according to the answers given. The sub-indices of the three subcategories were totaled and then divided by the maximum number of achievable points of all validly answered individual items. The average of the three scores of the subcategories were interpreted as the psychosocial workload index; this index ranges from 0 to 100 points.

The occupations of the participants in the 2018 BIBB/BAuA Employment Survey available in the dataset had been coded in accordance with a German classification of occupations. The coded job titles were grouped and assigned to twelve main occupational groups using the job classification published by BLOSSFELD in 1985 [27] (Production: agricultural occupations; unskilled manual occupations; skilled manual occupations; technicians; engineers; Service: unskilled services; skilled services; semiprofessions; professions; Administration: unskilled commercial and administrational occupations; skilled commercial and administrational occupations; managers).

Data privacy and ethics

In March 2017, the BAuA ethics committee approved the design and methods of the 2018 BIBB/BAuA Employment Survey. The dataset was provided in an anonymized manner. All personally identifiable information was removed from the dataset.

Statistical methods

The study used descriptive statistics and inference statistical approaches. Absolute and relative frequencies have been presented for the categorical variables, while the arithmetic mean and standard deviation (SD) have been provided for numeric variables. Generally, the descriptive statistics for all items used are shown stratified by the four categories of self-reported frequency of MHO (“never”, “rarely”, “sometimes”, and “often”). We reported the prevalence of the exposure variable MHO stratified by gender and for all BLOSSFELD occupational groups.

Loglinear Poisson regression analyses with robust variance estimation (generalized linear models, SPSS 25®, GENLIN) were conducted to assess the association between MHO and hand and arm complaints. The effect estimates were interpreted as prevalence ratios (PR). The marginal means of the outcome prevalence are provided for the exposure categories “never”, “rarely”, “sometimes” and “often”. The calculation of these means was based on post-estimations using the results of the fully adjusted regression Model #5. As a result, we have provided the adjusted prevalence stratified by the self-reported frequency of MHO, assuming that influencing categorical variables were evenly distributed [28]. Metric variables were centered (age = 45 years, weekly working hours = 40 h, psychosocial workload = 38.9 index points) [29]. The difference of the adjusted prevalence between the exposure categories can be interpreted as the absolute proportion of the prevalence which is attributable to the exposure.

A literature search [1,2,3, 8, 9, 12,13,14,15,16,17,18,19,20,21,22,23,24] was conducted to identify essential factors that may impact the outcome. The a-priori defined list of covariates were included in an underlying causal diagram and were considered in the regression models [30]. In addition to MHO, the following cofactors that were available in the dataset were included: age; gender; weekly working time; overhead work; manual lifting of heavy loads; climatic factors (“cold, heat, wet humidity, draught”); and psychosocial workload. The covariates were added to the regression models block by block:

  • Model #1: MHO only;

  • Model #2: #1 with age, gender;

  • Model #3: #2 and weekly working time;

  • Model #4: #3 and overhead work, manual lifting of heavy loads, climatic factors;

  • Model #5: #4 and psychosocial workload (fully adjusted model).

  • Model #6: #5 and interaction terms for MHO x Gender

This study will focus on two of these five models: the unadjusted Model #1, which only includes MHO as an exposure of interest, and the fully adjusted Model #5, which includes all listed variables. Based on the fully adjusted Model #5 we analyzed for both outcomes in Model #6 the interaction between manual handling operations (4 response categories) and gender (2 categories) using three interaction terms (“rarely MHO” x women; “sometimes MHO” x women; “often MHO” x women).

To assure each regression model has the same number of participants, only complete cases were considered. We selected datasets which were complete with regard to the exposure of interest, the two selected outcomes of interest (arm and hand pain) and all covariates. As a result, cases with missing variables have been excluded [31].

The post-estimation of the prevalence of hand and arm complaints for all categories of exposure to MHO was based on the results of the regression models and allowed for adjusted estimates of the outcome prevalence per exposure category with 95% confidence intervals (95% CI). Syntax-based statistical calculations were conducted using IBM SPSS Statistics 25.

Results

Study population

The 2018 BIBB/BAuA Employment Survey included 20,012 subjects. After applying the inclusion criteria, the sample size was reduced to 14,414 subjects. Of these, 14,375 employees responded to the question on hand pain, and 14,372 to the question on arm pain. Considering these two outcomes as well as all other variables included in the regression analyses, 14,299 cases with complete datasets were available and used for the analyses (Additional Table 1). The analyzed sample of 14,299 employees included 8,809 men (61.6%) men and 5,490 women (38.4%). The mean age of the subjects was 46.7 (SD 11.1); respondents reported a mean actual working time per week of 43.8 (SD 7.6) hours. The mean of the psychosocial workload index based on Kroll 2011 [26] was 38.9 (SD 11.8) index points (Table 1).

Table 1 Description of the study population stratified by the self-reported frequency of manual handling operations

Unadjusted prevalence of manual handling operations

A share of 32.6% of men and 31.1% of women indicated that they often perform MHO. Employees who reported that they often perform MHO also often lifted heavy loads (41.1%), often worked overhead (12.9%) or reported that they often work under cold climatic conditions, in heat, wet humidity, or draught (34.2%).

Men and women employed in occupations in the agricultural sector (e.g., farmers and forest workers), in unskilled manual occupations (e.g., construction helpers and road builders) or in skilled manual occupations (e.g., electricians and carpenters) reported that they frequently executed MHO. Women in semiprofessions (e.g., nurses) another large and important occupational group are often exposed to MHO. The distribution of the prevalence of manual handling operations in occupational sectors stratified by gender is provided in Table 2.

Table 2 Prevalence of manual handling operations stratified by the BLOSSFELD occupational groups and gender

Crude prevalence of hand and arm complaints

The crude prevalence of self-reported hand pain within the past 12 months is 14.2%. Hand pain is generally more common in women than in men (17.8 vs. 11.9%).

For both genders the prevalence increased in relation to the self-reported frequency of manual handling operations. Nearly 11.4% of women who reported that they “never” perform MHO experienced hand pain within the previous 12 months. In women, the prevalence increased over the following categories of frequency of MHO, with 12.6% in the category “rarely” 15.2% in the category “sometimes” and 30.2% in the category “often”. Men demonstrated a similar trend. The prevalence of a self-reported, 12-month prevalence of hand pain increased from 5.0% for men who reported that they “never” perform MHO, to 8.0 and 11.1% for men who were “rarely” and “sometimes” exposed, and to 22.3% for men in the highest exposure category (Table 1).

Regarding arm pain, the second outcome, 17.4% of subjects reported that they had suffered such complaints within the past 12 months. Generally, women more frequently expressed the occurrence of arm pain than men (21.0 vs. 15.2%). There was a strong increase in the prevalence of arm pain in relation to the self-reported frequency of manual handling operations from 10.6% in subjects who were never exposed to manual handling operations to 29.9% in subjects who were often exposed. This increase of prevalence related to the exposure to manual handling operations was found for men as well as for women (Table 1).

Association between manual handling operations and hand complaints

There was a strong association between MHO and hand pain in the unadjusted as well as in the adjusted models. All models showed a strong increase of the PR related to the increase of the self-reported frequency of MHO. In comparison to the adjusted models, the estimated association tended to be higher in the unadjusted model. According to the latter, subjects in the category “rarely performs MHO” had a 1.21-fold (CI 1.02–1.43) increased risk of suffering hand pain compared to subjects in the reference group who reported that they “never perform MHO”. Based on the unadjusted model, the risk of hand pain increased 1.60-fold (CI 1.38–1.86) to 3.25-fold (CI 2.45–3.60), respectively, for employees who stated that they “sometimes” or “often” perform MHO. After adjustment for confounders (age; gender; weekly working time; manual lifting of heavy loads; overhead work; and “cold, heat, wet humidity, draught”), the association between MHO and pain in the hands remained high. Employees who reported that they “rarely perform MHO” had a higher probability of self-reported pain in the hands within the last 12 months. The prevalence of hand pain in the group of employees who “sometimes” perform MHO was 1.34 (CI 1.15–1.57) times higher compared to subjects who “never” perform MHO. The prevalence ratio rose to 2.26 (CI 2.00–2.55) for subjects who reported that they “often” performed MHO (Table 3, Fig. 1). Other relevant physical workloads and exposures, such as working in extreme climatic conditions, were considered in the fully adjusted model. The relative risk for hand pain was associated with a high frequency of self-reported manual lifting of heavy loads (often: PR 1.34 CI 1.18–1.52), overhead work (PR 1.39 CI 1.23–1.56), and often working under difficult climatic factors (PR 1.50 CI 1.34–1.67) (Table 3). Compared to men, women showed a higher probability of self-reported hand pain within the past 12 months (PR 1.59 CI 1.47–1.72). The probability of reported hand pain increased by a factor of 1.10 (CI 1.07–1.15) per 10 years of age.

Table 3 Relative risk of hand pain as a prevalence ratio (PR) with a 95% confidence interval (95% CI) in unadjusted Model #1 and fully adjusted Model #5
Fig. 1
figure 1

Relative risk of self-reported of hand pain or complaints stratified by the self-reported frequency of manual handling operations. Prevalence ratios presented for the unadjusted Model #1 and the adjusted regression Models #2 to #5 (reference category = “Never performs manual handling operations”)

The adjusted prevalence was estimated based on the results of the fully adjusted Model #5. Employees who “often” performed MHO had the highest prevalence of hand pain (25.9% CI 24.0–28.0%). In employees who “sometimes”, “rarely” or “never” performed MHO, the prevalence of pain in the hands was 15.5% (CI 13.5–17.6%), 13.4% (CI 11.4–15.8%) and 13.4% (CI 11.4–15.8%), respectively. Therefore, if we compare subjects who “never performed MHO” to subjects who “often performed MHO”, nearly 12.5% of the total percentage of hand pain prevalence is attributable to the MHO workload.

In Model #6 we added three interaction terms to Model #5 to get estimates for the interaction between gender and the three higher exposure categories of manual handling operations. Comparable to Model #5 without interaction terms, the general estimates in Model #6 were increased for the higher categories of manual handling operations (“rarely MHO”: PR 1.44 CI 1.13–1.84; “sometimes MHO”: PR 1.75 CI 1.40–2.18; “often MHO”: PR 2.91 CI 2.44–3.48) as well as for women (PR 2.19 CI 1.83–2.62). The estimates of the interaction terms were lower than 1 (“rarely MHO” and “woman”: PR 0.71 (CI 0.50–1.00); “sometimes MHO” and “woman”: PR 0.63 (CI 0.47–0.85); and “often MHO” and “woman”: PR 0.65 (CI 0.53–0.80)). As result this pointed to a more additive than multiplicative type of interaction between gender and manual handling operations.

Association between manual handling operations and arm complaints

Similar to the results for hand pain as an outcome, we were able to prove a strong association between the self-reported frequency of manual handling operations and the prevalence of arm pain in the unadjusted as well as in the adjusted models. Regarding the unadjusted model the prevalence of arm pain is not significantly increased (PR 1.11 CI 0.96–1.29) in subjects who reported that they are rarely exposed to MHO; 1.50-fold (CI 1.32–1.70) in those who were sometimes exposed; and 2.77-fold (CI 2.54–3.02) in subjects who were often exposed, compared to subjects who were never exposed. The association was less characteristic if confounder variables were included in the regression model. Considering the fully adjusted Model #5 the prevalence ratio was 1.73 (CI 1.55–1.92) in the highest exposure category “often” and 1.16 (CI 1.02–1.33) in subjects who reported that they are sometimes exposed to manual handling operations (Table 4, Fig. 2). For other work related exposures (manual lifting of heavy loads; overhead work; climatic exposures; psychosocial workload; actual weekly working hours) and individual factors (age; gender) we find nearly the same associations to the self-reported frequency of manual handling operations as for hand pain (Table 4). The interaction between gender and self-reported exposure to manual handling operations showed a similar tendency for arm complaints as described for hand pain.

Table 4 Relative risk of arm pain or complaints as prevalence ratio (PR) with a 95% confidence interval (95% CI) in the unadjusted and fully adjusted Model #5
Fig. 2
figure 2

Relative risk of self-reported of arm pain or complaints stratified by the self-reported frequency of manual handling operations Prevalence ratios presented for the unadjusted Model #1 and the adjusted regression Models #2 to #5 (reference category = “Never performs manual handling operations”)

The adjusted prevalence of arm pain in subjects who never, rarely, sometimes, or often performed MHO was estimated based on regression Model #5 with 16.1% (CI 14.6–17.9%), 16.1% (CI 14.0–18.5%); 18.7% (CI 16.7–21.0%); and 27.9% (CI 26.0–29.9%), respectively. The percentage of arm pain prevalence attributable to the MHO workload is nearly 11.8% when comparing subjects who “never performed MHO” to subjects who “often performed MHO”.

Discussion

The study aimed to assess the exposure prevalence of manual handling operations (MHO) and the association between MHO and self-reported pain in the hands and arms using the data of the 2018 BIBB/BAuA Employment Survey. The results show that the prevalence of pain in the hands and arms within the past 12 months strongly increased in relation to the self-reported frequency of manual handling operations (MHO) in men and women. However, pain in the hands and arms is generally more common in women than in men. The results demonstrate that MHO is still a significant risk factor in the German working population. One third of all employed women and men reported that they “often” performed MHO. These highly exposed employees also reported that they are often exposed to other related physical or environmental risk factors such as manual lifting of heavy loads, overhead work or difficult climates. Most employees who worked in the agricultural sector (such as farmers and forest workers) and in unskilled manual occupations (such as construction helpers and road builders) or skilled manual occupations (such as electricians and carpenters) “often” performed manual handling operations.

We were able to show a strong association between the self-reported frequency of MHO and hand and arm pain in the unadjusted and as well as in the adjusted models. After adjusting for relevant confounders, the prevalence ratio for the categories “sometimes” and “often” remains high. The relationship between the self-reported frequency of MHO and hand and arm pain is generally more pronounced for “hand pain” than for the less specific outcome of “arm pain”. According to the results of the regression models, the adjusted prevalence of hand and arm pain increases with the self-reported frequency of manual handling operations.

It must be considered that the implemented analysis is based on a cross-sectional-study; it is therefore not possible to provide causal statements.

One advantage of the study is the large study population of 20,012 employees. 47.4% of reachable employees (n = 42,188) participated. A comparison of responders to non-responders is complicated, as basic information (age; education) is only available for 5.1% of them.

Although the percentage of men and women is equally distributed within the German population [32], men were more prevalent than women in our study population. This may be explained by the inclusion criteria applied to this analysis: employees who work less than 35 h per week had been excluded. As a result, many women were not considered in the analysis. But, the restriction regarding working time was introduced to minimize the effect of unmeasured confounding by leisure time activities, gardening or sport activities, which were not assessed in the 2018 BIBB/BAuA Employment Survey. Regardless of this restriction adjustment of the regression models taking into account working hours was still necessary due to the remaining variance of weekly working time in the resulting study sample (mean (SD): 43.8 h (7.6 h); median: 40 h; IQR: 12 h).

When interpreting the results, we must consider a healthy worker effect [33]. This effect can impact all categories of MHO. It should be taken into account that employees who remain in occupations with high workloads of MHO adapt to their working conditions, whereas employees with health conditions are more likely to leave the workplace or switch to less exposed fields of work. Therefore, the real effect estimates of MHO with regards to the prevalence of hand pain may be higher.

Another consideration is that the 2018 BIBB/BAuA Employment Survey covered a wide range of work-related aspects, with only a relatively short timeframe available for the interviews. This limited the ability to derive specific and multifarious information on individual exposures and outcomes. For example, requirements of manual handling operations were only covered by one short question with a limited spectrum of answers. MHO, however, is related to a wide range of different physical demands, including heavy physical work and precise manual work. In the survey, different requirements (high dexterity; applying great strength with the hands and arms; repetitive activities) of manual work are covered by one question. To understand which activity has the strongest influence on the hands and forearms, the workload assessment needs to be based on objective workplace risk assessments and measurements. Obtaining sufficient information on work-related exposure is one of the most challenging quality problems epidemiological studies face. In their review, da Costa et al. [3] discussed how studies that investigate the risk factors for the development of work-related musculoskeletal disorders should report exposure levels in detail. They added that if repetition is identified as a risk factor, the number of repetitions necessary for it to become a risk should be reported as accurately as possible. The expenditure required to obtain information on exposure in such detail is immense. Even in ergonomic field studies, which perform deep ergonomic workplace evaluations with regard to MHO [34, 35], exposures are only assessed at a workplace level, not for individual employees, and not retrospectively. Since such deep exposure assessments are not applicable in large telephone surveys such as the 2018 BIBB/BAuA Employment Survey, we have to consider the limitations of information related to self-assessments and single-item measurements of exposure and confounding variables. A more advanced approach asking the major key indicators characterizing manual handling operations (duration per day, repetitions, force requirements, or arm posture) should be used to face the problem of mono-methods-bias. It should be noted that the manual handling operations are linked not only with short-term effects like discomfort, but also with specific diseases as long-term outcomes. Here, dose–response relationship between cumulative occupational exposure to manual handling operations, like force and repetition and CTS could be shown [36].

It is also necessary to discuss the wording of the questions on work-related exposures and health outcomes in BIBB/BAuA Employment Surveys. Employees were only able to choose between the categories “never”, “rarely”, “sometimes” and “often” to rate the intensity of manual handling operations and other work-related aspects. The categories employed here cannot be linked to an actual time of exposure or an absolute frequency per day. Employment surveys conducted in other countries, such as Denmark, Norway, and Spain, on the other hand, obtain information on parts of the working day [37]. This also addresses the issue that most of the items used in the BIBB/BAuA Employment Surveys were proprietarily developed.

However, surveys can assess the outcome in a more differentiated manner. When asked whether they had experienced pain in the hands within the last 12 months, participants only had the option of answering with “yes” or “no”. It is not possible to rate the intensity or frequency of reported pain within the last 12 months in this manner. We can also assume that the ability to remember pain episodes and intensities varies [38]. On the other hand, the questions on health outcomes should be improved. The anatomical regions of “hands” and “arms” are not sufficiently specific to obtain precise information on complaints in hands, forearms, elbows, and shoulders. The general wording of the question is unfortunately conditional to the occurrence of pain while at or after work. At this point, we suggest a more specific and unconditional operationalization of health outcomes in BIBB/BAuA Employment Surveys.

Furthermore, a limitation of the study is that important confounders were not assessed and could not be considered in our analysis. On the one hand important occupational factors for hand pain, like hand-arm vibrations and on the other hand important individual factors like body height and weight, and smoking behavior were missing. Future BIBB/BAuA Employment Surveys should consider these aspects.

Poisson regression with robust variance estimation was chosen to directly estimate the prevalence ratio as a directly interpretable effect estimate, although the outcome variable is binary and would implicate a logistic regression approach. According to Barros et al. [39], analyses that use Poisson regression with robust variance estimation produce the same results as analyses that use binomial logistic regression. Chen et al. [40] also showed that a robust variance estimation can handle outliers. This allows us to consider a relatively large number of confounders within the models.

Due to the low number of missing data, we chose a complete-case analysis and assumed that missing values occurred completely at random [31].

The sixth European Working Conditions Survey, conducted by Eurofound in 2017 [5], and the 2012 BIBB/BAuA Employment Survey report a similar prevalence of MHO. Moreover, the results of the study support the idea that the German working population is still frequently exposed to MHO. Furthermore, the prevalence of pain in the hands deviates just slightly from the results of the earlier BIBB/BAuA Employment Survey in 2012. We should consider, that new and evaluated tools are available to assess workplace risks in the case of manual handling operations [34]. Additionally, Germany implemented a binding offer for preventive occupational health consultations for employees exposed to manual handling operations and other physical workloads in 2013 [41]. Beside this, the Joint German Occupational Safety and Health Strategy (GDA, www.gda-portal.de) put into practice specific workplace prevention programs to reduce the negative impact of physical workload at national level since 2008. The findings additionally coincide with the results of Balogh et al. [18], namely that there is a higher prevalence of disorders in the hand among women. The different ways of assessing MHO make it difficult to compare the results of this study to others. The estimated high positive association between MHO and pain in the hands for the adjusted model are in accordance with the findings of the systematic reviews of Palmer et al. [1] and van Rijn et al. [2].

Conclusion

In conclusion, the results presented here show that manual handling operations are still a significant occupational exposure in the German workforce. The 2018 BIBB/BAuA Employment Survey confirmed the known association between MHO and pain in the hands in current working conditions. Employees who “often” perform manual handling operations are especially affected. Therefore, the necessity of prevention measures for occupational groups that often execute MHO is high. These groups include employees in the agricultural sector, services as well as unskilled and skilled manual occupations. The results of this study can be used to justify needs for prevention, to focus on highly affected occupations and to optimize preventive approaches. By setting policies and implementing them within companies, we can reduce the negative impact of MHO on the health of employees. Although according to the reviews of van Eerd et al. [42] and Verhagen et al. [43] evidence about the effectiveness of interventions in the prevention of upper extremity musculoskeletal disorders and symptoms is limited, the implementation of automated or semi-automated processes may reduce the physical workload [44]. In light of the attributable fraction among the exposed, the results suggest a reduction target of at least ten percentage points for pain in the arms and hands if the (self-reported) frequency of manual handling operations were to be reduced from “often” to “never”.

Availability of data and materials

The complete dataset of the 2018 BIBB/BAuA Employment Survey supporting the conclusions of this article is available as open Scientific-Use-File (no. ZA7574) and can be requested at “BIBB – Bundesinstitut für Berufsbildung—Forschungsdatenzentrum” (PO box 201,264; D-53142 Bonn; Germany; fax number: + 49–(0)228–107–2020); https://www.bibb.de/de/120401.php). The dataset will be available as ftp-download after approved application.

Abbreviations

BAuA:

Federal Institute for Occupational Safety and Health

BIBB:

Federal Institute for Vocational Education and Training

CI:

Confidence interval

EU-OSHA:

European Agency for Safety and Health at Work

MHO:

Manual handling operations

MSD:

Musculoskeletal disorders

PR:

Prevalence ratio

SD:

Standard deviation

References

  1. Palmer KT, Harris EC, Coggon D. Carpal tunnel syndrome and its relation to occupation: a systematic literature review. Occup Med (Lond). 2007;57(1):57–66. https://0-doi-org.brum.beds.ac.uk/10.1093/occmed/kql125.

    Article  Google Scholar 

  2. van Rijn RM, Huisstede BM, Koes BW, Burdorf A. Associations between work-related factors and the carpal tunnel syndrome--a systematic review. Scand J Work Environ Health. 2009;35(1):19–36. https://0-doi-org.brum.beds.ac.uk/10.5271/sjweh.1306.

    Article  PubMed  Google Scholar 

  3. da Costa BR, Vieira ER. Risk factors for work-related musculoskeletal disorders: a systematic review of recent longitudinal studies. Am J Ind Med. 2010;53(3):285–323. https://0-doi-org.brum.beds.ac.uk/10.1002/ajim.20750.

    Article  PubMed  Google Scholar 

  4. Steinberg U, Liebers F. Manuelle Arbeit ohne Schaden. Grundsätze und Gefährdungsbeurteilung [Manual work without harm - principles and risk assessment]. Dortmund: BAuA; 2014. https://www.baua.de/DE/Angebote/Publikationen/Praxis/A55.html (06.07.2020).

    Google Scholar 

  5. Eurofound. Sixth European working conditions survey – overview report (2017 update). Luxembourg: Publications Office of the European Union; 2017. https://www.eurofound.europa.eu/publications/report/2016/working-conditions/sixth-european-working-conditions-survey-overview-report (06.07.2020).

    Google Scholar 

  6. Crawford JO, Davis A. Work-related musculoskeletal disorders: why are they still so prevalent? Evidence from a literature review - European risk observatory report. Luxembourg: Publications Office of the European Union, European Agency for Safety and Health at Work; 2020. https://osha.europa.eu/de/publications/work-related-musculoskeletal-disorders-why-are-they-still-so-prevalent-evidence (26.06.2020).

    Google Scholar 

  7. Wittig P, Nöllenheidt C, Brenscheidt S. Grundauswertung der BIBB/BAuAErwerbstätigenbefragung 2012 Männer/Frauen in Vollzeit mit den Schwerpunkten Arbeitsbedingungen, Arbeitsbelastungen und gesundheitliche Beschwerden [Basic analysis of the 2012 BIBB/BAuA employment survey fro men/women in full-time jobs and focusing on working conditions, workloads and health complaints]. Dortmund, Berlin, Dresden: Federal Institute for Occupational Safety and Health (BAuA); 2013. https://www.baua.de/DE/Angebote/Publikationen/Berichte/F2417-2.html (06.07.2020).

  8. Bernard BP, Putz-Anderson V. Musculoskeletal disorders and workplace factors: a critical review of epidemiologic evidence for work-related musculoskeletal disorders of the neck, upper extremity, and low back. Cincinnati: National Institute for Occupational Safety and Health (NIOSH); 1997. https://www.cdc.gov/niosh/docs/97-141/default.html (07.06.2020).

    Google Scholar 

  9. da Costa JT, Baptista JS, Vaz M. Incidence and prevalence of upper-limb work related musculoskeletal disorders: a systematic review. Work. 2015;51(4):635–44. https://0-doi-org.brum.beds.ac.uk/10.3233/WOR-152032.

    Article  PubMed  Google Scholar 

  10. DGUV. DGUV-Statistiken für die Praxis 2018 - Aktuelle Zahlen und Zeitreihen der gewerblichen Berufsgenossenschaften und Unfallversicherungsträger der öffentlichen Hand [DGUV statistics for practice 2018 - current figures and time series of the industrial accident insurence companies and the accident insurance companies of the public sector]. Berlin: Deutsche Gesetzliche Unfallversicherung (DGUV); 2018. https://publikationen.dguv.de/zahlen-fakten/ueberblick/3673/dguv-statistiken-fuer-die-praxis-2018 (06.07.2020).

  11. World Health Organization. Identification and control of work-related diseases: report of a WHO expert committee. Geneva: World Health Organization; 1985. https://apps.who.int/iris/handle/10665/40176 (06.07.2020).

    Google Scholar 

  12. Hildebrandt VH, Bongers PM, van Dijk FJ, Kemper HC, Dul J. The influence of climatic factors on non-specific back and neck-shoulder disease. Ergonomics. 2002;45(1):32–48. https://0-doi-org.brum.beds.ac.uk/10.1080/00140130110110629.

    Article  CAS  PubMed  Google Scholar 

  13. Warrender WJ, Henstenburg J, Maltenfort M, Lutsky K, Beredjiklian PK. Seasonal variation in the prevalence of common orthopaedic upper extremity conditions. J Wrist Surg. 2018;7(3):232–6. https://0-doi-org.brum.beds.ac.uk/10.1055/s-0037-1612637.

    Article  PubMed  Google Scholar 

  14. Piedrahı́ta H, Punnett L, Shahnavaz H. Musculoskeletal symptoms in cold exposed and non-cold exposed workers. Int J Ind Ergon. 2004;34(4):271–8. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ergon.2004.04.008.

    Article  Google Scholar 

  15. Pienimaki T. Cold exposure and musculoskeletal disorders and diseases. A review. Int J Circumpolar Health. 2002;61(2):173–82. https://0-doi-org.brum.beds.ac.uk/10.3402/ijch.v61i2.17450.

    Article  PubMed  Google Scholar 

  16. Roquelaure Y, Ha C, Rouillon C, Fouquet N, Leclerc A, Descatha A, Touranchet A, Goldberg M, Imbernon E, Members of Occupational Health Services of the Pays de la Loire R. Risk factors for upper-extremity musculoskeletal disorders in the working population. Arthritis Rheum. 2009;61(10):1425–34. https://0-doi-org.brum.beds.ac.uk/10.1002/art.24740.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Treaster DE, Burr D. Gender differences in prevalence of upper extremity musculoskeletal disorders. Ergonomics. 2004;47(5):495–526. https://0-doi-org.brum.beds.ac.uk/10.1080/00140130310001638171.

    Article  CAS  PubMed  Google Scholar 

  18. Balogh I, Arvidsson I, Bjork J, Hansson GA, Ohlsson K, Skerfving S, Nordander C. Work-related neck and upper limb disorders - quantitative exposure-response relationships adjusted for personal characteristics and psychosocial conditions. BMC Musculoskelet Disord. 2019;20(1):139. https://0-doi-org.brum.beds.ac.uk/10.1186/s12891-019-2491-6.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Capodaglio P, Castelnuovo G, Brunani A, Vismara L, Villa V, Capodaglio EM. Functional limitations and occupational issues in obesity: a review. Int J Occup Saf Ergon. 2010;16(4):507–23. https://0-doi-org.brum.beds.ac.uk/10.1080/10803548.2010.11076863.

    Article  PubMed  Google Scholar 

  20. Shiri R, Pourmemari MH, Falah-Hassani K, Viikari-Juntura E. The effect of excess body mass on the risk of carpal tunnel syndrome: a meta-analysis of 58 studies. Obes Rev. 2015;16(12):1094–104. https://0-doi-org.brum.beds.ac.uk/10.1111/obr.12324.

    Article  CAS  PubMed  Google Scholar 

  21. Al-Bashaireh AM, Haddad LG, Weaver M, Kelly DL, Chengguo X, Yoon S. The effect of tobacco smoking on musculoskeletal health: a systematic review. J Environ Public Health. 2018;2018(4184190):1–190. https://0-doi-org.brum.beds.ac.uk/10.1155/2018/4184190.

    Article  Google Scholar 

  22. Mansfield M, Thacker M, Sandford F. Psychosocial risk factors and the association with carpal tunnel syndrome: a systematic review. Hand (N Y). 2018;13(5):501–8. https://0-doi-org.brum.beds.ac.uk/10.1177/1558944717736398.

    Article  Google Scholar 

  23. Putrik P, Ramiro S, Chorus AM, Keszei AP, Boonen A. Socioeconomic inequities in perceived health among patients with musculoskeletal disorders compared with other chronic disorders: results from a cross-sectional Dutch study. RMD Open. 2015;1(1):e000045. https://0-doi-org.brum.beds.ac.uk/10.1136/rmdopen-2014-000045.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Mackenbach JP, Stirbu I, Roskam AJ, Schaap MM, Menvielle G, Leinsalu M, Kunst AE, European Union Working Group on Socioeconomic Inequalities in H. Socioeconomic inequalities in health in 22 European countries. N Engl J Med. 2008;358(23):2468–81. https://0-doi-org.brum.beds.ac.uk/10.1056/NEJMsa0707519.

    Article  CAS  PubMed  Google Scholar 

  25. Rohrbach-Schmidt D, Hall A. BIBB/BAuA employment survey 2018 version 1.0. Bonn: BIBB (Federal Institute for Vocational Education and Training); 2020. https://www.bibb.de/veroeffentlichungen/de/publication/show/16563 (23.11.20202).

    Google Scholar 

  26. Kroll LE. Konstruktion und Validierung eines allgemeinen Index für die Arbeitsbelastung in beruflichen Tätigkeiten anhand von ISCO-88 und KldB-92 [Construction and validation of a general index for job demands in occupations based on ISCO-88 and KldB-92]. Methoden Daten Anal. 2011;5(1):63–90. https://0-doi-org.brum.beds.ac.uk/10.25646/1580.

    Article  Google Scholar 

  27. Blossfeld H-P. Bildungsexpansion und Berufschancen : empirische Analysen zur Lage der Berufsanfänger in der Bundesrepublik [Educational Expansion and Professional Opportunities: Empiric Analysis of Young Professionals' Situation]. Frankfurt: Campus; 1985.

  28. Eckey HF, Kosfeld R, Rengers M. Multivariate Statistik: Grundlagen - Methoden - Beispiele. Wiesbaden: Gabler Verlag; 2013.

    Google Scholar 

  29. Fahrmaier L, Kneib T, Lang S. Regression - Modelle, Methoden und Anwendungen [Regression - models, methods and applications]. Berlin, Heidelberg, New York: Springer; 2007.

    Google Scholar 

  30. Glymour M, Greenland S. Causal diagrams. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. Philadelphia: Wolters Kluwer, Lippincot Williams & Wilkins; 2008. p. 183–209.

    Google Scholar 

  31. Pigott TD. A review of methods for missing data. Educ Res Eval. 2001;7(4):353–83.

    Article  Google Scholar 

  32. DESTATIS. Bevölkerung im Wandel - Annahmen und Ergebnisse der 14. koordinierten Bevölkerungsvorausberechnung [Changing population - assumptions and results of the 14th coordinated population projection]. Wiesbaden: Statistisches Bundesamt (DESTATIS); 2019. https://www.destatis.de/DE/Presse/Pressekonferenzen/2019/Bevoelkerung/pressebroschuere-bevoelkerung.pdf (07.06.2020).

    Google Scholar 

  33. Li CY, Sung FC. A review of the healthy worker effect in occupational epidemiology. Occup Med (Lond). 1999;49(4):225–9. https://0-doi-org.brum.beds.ac.uk/10.1093/occmed/49.4.225.

    Article  CAS  Google Scholar 

  34. Klussmann A, Liebers F, Gebhardt H, Rieger MA, Latza U, Steinberg U. Risk assessment of manual handling operations at work with the key indicator method (KIM-MHO) - determination of criterion validity regarding the prevalence of musculoskeletal symptoms and clinical conditions within a cross-sectional study. BMC Musculoskelet Disord. 2017;18(1):184. https://0-doi-org.brum.beds.ac.uk/10.1186/s12891-017-1542-0.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Klussmann A, Gebhardt H, Rieger M, Liebers F, Steinberg U. Evaluation of objectivity, reliability and criterion validity of the key indicator method for manual handling operations (KIM-MHO), draft 2007. Work. 2012;41(Suppl 1):3997–4003. https://0-doi-org.brum.beds.ac.uk/10.3233/WOR-2012-0699-3997.

    Article  PubMed  Google Scholar 

  36. Kozak A, Schedlbauer G, Wirth T, Euler U, Westermann C, Nienhaus A. Association between work-related biomechanical risk factors and the occurrence of carpal tunnel syndrome: an overview of systematic reviews and a meta-analysis of current research. BMC Musculoskelet Disord. 2015;16:231. https://0-doi-org.brum.beds.ac.uk/10.1186/s12891-015-0685-0.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Tynes T, Aagestad C, Thorsen SV, Andersen LL, Perkio-Makela M, Garcia FJP, Blanco LG, Vermeylen G, Parent-Thirion A, Hooftman W, Houtman I, Liebers F, Burr H, Formazin M. Physical working conditions as covered in European monitoring questionnaires. BMC Public Health. 2017;17(1):544. https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-017-4465-7.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Pearce N, Checkoway H, Kriebel D. Bias in occupational epidemiology studies. Occup Environ Med. 2007;64(8):562–8. https://0-doi-org.brum.beds.ac.uk/10.1136/oem.2006.026690.

    Article  PubMed  Google Scholar 

  39. Barros AJ, Hirakata VN. Alternatives for logistic regression in cross-sectional studies: an empirical comparison of models that directly estimate the prevalence ratio. BMC Med Res Methodol. 2003;3(21):1–13.

    Google Scholar 

  40. Chen W, Shi J, Qian L, Azen SP. Comparison of robustness to outliers between robust poisson models and log-binomial models when estimating relative risks for common binary outcomes: a simulation study. BMC Med Res Methodol. 2014;14:82. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2288-14-82.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Occupational Health Care Ordinance [Verordnung zur arbeitsmedizinischen Vorsorge (ArbMedVV)] of 18 December 2008 (Federal Law Gazette part I [Bundesgesetzblatt Teil I] 2008, 62:2768-79), as last amended by Article 1 of the Ordinance of 12 July 2019 (Federal Law Gazette part I [Bundesgesetzblatt Teil I] 2019, 27:1082). Cologne, Bundesanzeiger Verlag GmbH. https://www.bgbl.de/xaver/bgbl/start.xav?startbkhttp://www.bgbl.de/xaver/bgbl/start.xav?start=Bundesanzeiger_BGBl&jumpTo=bgbl108s2768.pdf#__bgbl__%2F%2F*%5B%40attr_id%3D%27bgbl108s2768.pdf%27%5D__1626181521444:

  42. van Eerd D, Munhall C, Irvin E, Rempel D, Brewer S, van der Beek AJ, Dennerlein JT, Tullar J, Skivington K, Pinion C, Amick B. Effectiveness of workplace interventions in the prevention of upper extremity musculoskeletal disorders and symptoms: an update of the evidence. Occup Environ Med. 2016;73(1):62–70. https://0-doi-org.brum.beds.ac.uk/10.1136/oemed-2015-102992.

    Article  PubMed  Google Scholar 

  43. Verhagen AP, Bierma-Zeinstra SM, Burdorf A, Stynes SM, de Vet HC, Koes BW. Conservative interventions for treating work-related complaints of the arm, neck or shoulder in adults. Cochrane Database Syst Rev. 2013;2013(12):Cd008742. https://0-doi-org.brum.beds.ac.uk/10.1002/14651858.CD008742.pub2.

    Article  PubMed Central  Google Scholar 

  44. Balogh I, Ohlsson K, Hansson G-Å, Engström T, Skerfving S. Increasing the degree of automation in a production system: consequences for the physical workload. Int J Ind Ergon. 2006;36(4):353–65. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ergon.2004.09.009.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Prof. Dr. Ute Latza for her support and setting our thinking. We thank Dr. Lena Hünefeld and colleagues for providing the dataset of the 2018 BiBB/BAuA Employment Survey. We also would like to thank Eurolingua.de (Dortmund) for proofreading and checking the language of the draft.

Funding

Open Access funding enabled and organized by Projekt DEAL. The study is part of the scientific project no. F2456 of the Federal Institute for Occupational Safety and Health (BAuA) and focuses on physical working exposures and complaints of the musculoskeletal system. Further information is available online at: www.baua.de/DE/Aufgaben/Forschung/Forschungsprojekte/f2456.html. This study used the dataset of the 2018 BIBB/BAuA Employment Survey which was a scientific project of the Federal Institute for Occupational Safety and Health (BAuA). The funding bodies (BAuA) played no role in the design of the study and analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

FL and CM did the conception of the work, FL and MS prepared the data for analysis, CM and FL analyzed the data, all authors worked on the interpretation of data, CM and FL prepared the manuscript; MS and JB reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Falk Liebers.

Ethics declarations

Ethics approval and consent to participate

The ethics committee of the Federal Institute of Occupational Safety and Health (BAuA) approved the 2018 BIBB/BAuA Employment Survey (committee’s reference no.: EK007_2017, 09 January 2017).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests. FL is employed as Senior Scientist at the BAuA. CM, MS and JB were students at Charité-Universitaetsmedizin Berlin and were employed as student assistants at the BAuA.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Additional Table 1.

Number of missing values per item after applying of selection criteria considering subjects aged <67 and at least 35 h weekly working time.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mueller, C., Sauter, M., Barthelme, J. et al. The association between manual handling operations and pain in the hands and arms in the context of the 2018 BIBB/BAuA Employment Survey. BMC Musculoskelet Disord 22, 644 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12891-021-04495-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12891-021-04495-z

Keywords