Skip to main content

Advertisement

Reliability and criterion-related validity with a smartphone used in timed-up-and-go test

BioMedical Engineering OnLinevolume 13, Article number: 156 (2014) | Download Citation

Article metrics

Abstract

Background

The capacity to diagnosys, quantify and evaluate movement beyond the general confines of a clinical environment under effectiveness conditions may alleviate rampant strain on limited, expensive and highly specialized medical resources. An iPhone 4® mounted a three dimensional accelerometer subsystem with highly robust software applications. The present study aimed to evaluate the reliability and concurrent criterion-related validity of the accelerations with an iPhone 4® in an Extended Timed Get Up and Go test. Extended Timed Get Up and Go is a clinical test with that the patient get up from the chair and walking ten meters, turn and coming back to the chair.

Methods

A repeated measure, cross-sectional, analytical study. Test-retest reliability of the kinematic measurements of the iPhone 4® compared with a standard validated laboratory device. We calculated the Coefficient of Multiple Correlation between the two sensors acceleration signal of each subject, in each sub-stage, in each of the three Extended Timed Get Up and Go test trials. To investigate statistical agreement between the two sensors we used the Bland-Altman method.

Results

With respect to the analysis of the correlation data in the present work, the Coefficient of Multiple Correlation of the five subjects in their triplicated trials were as follows: in sub-phase Sit to Stand the ranged between r = 0.991 to 0.842; in Gait Go, r = 0.967 to 0.852; in Turn, 0.979 to 0.798; in Gait Come, 0.964 to 0.887; and in Turn to Stand to Sit, 0.992 to 0.877. All the correlations between the sensors were significant (p < 0.001). The Bland-Altman plots obtained showed a solid tendency to stay at close to zero, especially on the y and x-axes, during the five phases of the Extended Timed Get Up and Go test.

Conclusions

The inertial sensor mounted in the iPhone 4® is sufficiently reliable and accurate to evaluate and identify the kinematic patterns in an Extended Timed Get and Go test. While analysis and interpretation of 3D kinematics data continue to be dauntingly complex, the iPhone 4® makes the task of acquiring the data relatively inexpensive and easy to use.

Background

The human movement evaluation is considered to be a cornerstone of both the generation of knowledge and the assessment of the effect of clinical treatments [1]. The most commonly technique of human movement evaluation used in physical therapy clinical practice has been the one-dimensional movable-arm goniometry [1–3]. The devices used in this clinical practice, however, provide information on motion in just a single plane [3]. Laboratory systems designed to measure more dimensions and with greater precision are complex and expensive [1]. The commonest are electromagnetic and optoelectronic video systems [4]. A major drawback of the electromagnetic devices is that they may be adversely affected by the presence of metals [5], and they are limited to the area covered by the source of the magnetic field and by the wiring connecting the sensors to the source. Optoelectronic systems, too, present serious limitations due to their complexity and the time needed to perform the entire process [6]. Currently, new motion analysis devices are being developed that are smaller, lighter, portable, and precise, so as to offer a better alternative for the measurement of patterns of movement in a practical clinical setting [4].

The latest generation of smartphones often incorporate micro-electromechanical inertial systems with accelerometers and gyroscopes that can detect acceleration and measure for rate Cobb Angles [7], functional balance tests or tasks such as Timed Get Up and Go Extended [8], Sit-to-Stand and Stand-to-Sit transitions [9] or analysing frail older adults during a turn transition [10]. There are applications available which can read, store, transfer, and display data from the accelerometer and gyroscope, endowing these smartphones with an enormous potential for monitoring the parameters of human movement in general, and for clinical use in particular.

The objective of the present study was to evaluate the reliability and concurrent criterion-related validity of the measurements of acceleration in each of the three axes of motion as obtained from an iPhone 4® during the performance of an Expanded Timed-Get-Up-and-Go (ETGUG) test.

Methods

Design and participants

A cross-sectional, repeated measure, analytical study was designed to examine the intra-individual reliability and concurrent criterion-related validity of the smartphone iPhone 4® in the ETGUG test. Five participants were recruited from a healthy over-65 population. The exclusion criteria were a history of pain in the last twelve months, or a history of surgery, malignancy, or musculoskeletal disorders of any limb that might be aggravated by the procedures involved in the test. Informed consent was obtained from all subjects, and study procedures were consistent with the Helsinki declaration. The study was approved by the local University Committee.

Inertial sensors

The participants wore the two sensors overlapping in a small neoprene sleeve, placed at the level of the middle third of the sternum. Previous studies on the variability of inertial sensor measurements placed at the levels of different body segments [11, 12] show that sensors located at the level of the sternum provide reliable data. The first of the sensors used was an Inertiacube3® (IC3; Intersense, Bedford, MA, USA). This module integrates two two-axes accelerometer, three singles-axis gyroscopes and a three-axis magnetometer compass within low volume (26.2 × 39.2 × 14.8 mm3). InertiaCube3 combines the aforementioned sensing elements with an integrated Kalman filtering algorithm. The unit can provide orientation and gravity compensated acceleration information aligned with the Earth’s magnetic north. InertiaCube3 can measured accelerations up to ±6 g [13], in this study were studied only the values obtained from the accelerometer subunit.

The second sensor (the one to be validated in the present study) was that incorporated in the iPhone 4® of Apple®. This smartphone is equipped, as is the IC3, with three triaxial elements for the detection of kinematic variables: a gyroscope, a magnetometer, and an accelerometer. Apple uses an LIS302DL accelerometer in the iPhone 4® [14]. Kinematic data were acquired using the xSensor® Pro software of Crossbow Technology, Inc. This app couldn’t record at higher sampling rates than 32 Hz. A previous study [7] had validated the iPhone 4®’s gyroscope, showing the inter-observer error to be 4.0° (standard deviation of the difference between measurements).

The orientation and movement of these two sensors are presented as Euler angles RPY (roll, pitch, and yaw). If the sensor’s RPY axes are aligned with the anatomical axes of the trunk, the roll angle of a movement is around the anteroposterior (AP) axis [15]. Movements in this plane are less frequent than those in other planes [16]. The pitch angle is around the left-right (or mediolateral, ML) axis [15], and the yaw angle is around the vertical (V) axis [15].

Test protocol

The subjects performed the ETGUG test three times. They used a chair without armrests, and were instructed orally not to use their arms to stand up or sit down. Various studies have explored this test using chairs without armrests [17–19]. This choice could reduce inter-subject variability by eliminating the option of whether or not to use the arms in the standing up and sitting down phases. The ETGUG test selected was that using a 10 metres long corridor, the aim being to include as many gait cycles during the test as possible [19]. The beginning and end of the ten metres were marked on the floor with 2½-cm wide tape. The protocol was as follows:

  1. 1)

    The subject sat with his or her back in contact with the back of the chair (the seat was 460 mm high and lacks armrests).

  2. 2)

    The ETGUG begins with the therapist’s go sign and the subject stands up (Sit-to-Stand).

  3. 3)

    The subject begins walking ten meters (Gait Go).

  4. 4)

    The subject turns around a wide tape mark placed 10 m away from the chair (Turn).

  5. 5)

    The subject walks back toward the chair (Gait Come).

  6. 6)

    The subject turns away from the chair to sit down (Turn-to-Stand-to-Sit).

To evaluate the test-retest reliability of the iPhone 4®’s kinematic measurements, the participants repeated the protocol three times. The first and second trials were completed consecutively for reliability and after the two sensors were removed from the participant’s body following an hour of rest, the sensors were put back in the same position, and the ETGUG test protocol was repeated to evaluate the stability of the measurement after removing and then putting back the two sensors. It was assumed that the participant’s performance remained unchanged within the time of this resting period. The same examiner used the same device and the same protocol to place the devices, and to conduct the ETGUG test.

Sub-phases of the expanded timed-get-up-and-go test

After the test, and based on the analysis of the accelerometry data of all the participants, the ETGUG test was divided into 5 main sub-stages: from sitting to standing (Sit-to-Stand, Si-St), gait going away (Gait Go, GG), turn (T), gait coming back (Gait Come, GC), and turning to sit down (Turn-to-Stand-to-Sit, T-St-Si) (Figure 1). The different sub-phases were detected with the sensor parameters as follows:

  • For the identification and analysis of the sitting-standing transitions (Si-St and T-St-Si), we followed a previously published protocol [20] (Figure 1).

  • For the identification and analysis of the turn transition (T), we also followed a previously published method [21] in which 180° rotations are detected by analysing the yaw rotation signal, which should identify the first turn at ten metres and the second turn which is made in order to sit down and thus terminate the test (Figure 1).

  • The identification and analysis of the GG and GC sub-phases was performed by analysing the data remaining once the Si-St and T-St-Si [20] and T [21] sub-phases had been detected and delimited.

Figure 1
figure1

Accelerometry identification of the ETGUG components – representation of the pitch and yaw signals (in degrees).

Full size image

Signal processing

The IC3 data were acquired at a 100 Hz sampling frequency, and those of the iPhone 4® at 32 Hz. Data processing was performed off-line, expanding and synchronizing the two sets of time series using the basic package of the R® software environment.

Statistical analysis

We performed descriptive statistics with measures of central tendency and dispersion of the maximum and minimum peak acceleration in AP, ML, V and the acceleration magnitude (AM). The AM is a vector that has the same effect on the system as the component vectors. AM is calculated from the three acceleration vectors of the axes of motion (x, y, z) as the square root of the sum of the values of the three axes (AM = √x2 + y2 + z2). Analyses of the relations between the scores obtained by simultaneously from IC3 and iPhone 4® were performed. The relations were studied by using the Coefficient of Multiple Correlation (CMC) [22]. Cohen and Holiday criteria [23] were applied to interpret these correlation coefficients, suggesting the following categorization: very low correlation for values below 0.20; low correlation for values between 0.20 and 0.39; moderate correlation for values between 0.40 and 0.69; high correlation for values between 0.70 and 0.89 and very high correlation for values above 0.89. To evaluate the reliability of the iPhone 4® measurements, we calculated the intraclass correlation coefficient (ICC) between the two sensors acceleration signal. Values between 0.70 and 0.95 were considered acceptable reliability indicators [23]. To investigate statistical agreement between the two sensors we used the Bland-Altman method [24].

Results

Table 1 presents the descriptive statistics of the anthropometric information of the five participants in the study, and their scores in times for each of the sets of three ETGUG trials. The two sets of ETGUG test kinematic data for the iPhone 4® and IC3, maximum and minimum peaks, for the AP, ML, V and the AM are summarized in Table 2. The results of the CMC analysis between the resultant vectors of the two time series in the different sub-phases of the ETGUG test are presented in Table 3. All the correlations between the sensors were significant (p < 0.001). The CMC of the five subjects in their triplicated trials were as follows: in sub-phase Si-St the ranged between r = 0.991 to 0.842; in GG, r = 0.967 to 0.852; in T, 0.979 to 0.798; in GC, 0.964 to 0.887; and in T-St-Si, 0.992 to 0.877 (Table 3). Table 4 presents the Intra-class correlations (ICC) for IC3 peak acceleration and iPhone 4® peak acceleration, the lower value ICC was 0.819 and the higher value was 0.987. Figure 2 shows a graphical example of a subject in which one observes the strong correlation between the sensors, and the high level of agreement between the signals of the two motion sensors in the different sub-phases of the test. The whole 225 worked out Bland-Altman plots obtained showed a solid tendency to stay agreement, Figure 3 shows the Bland-Altman plot of GG sub-phase of the ETGUG test, in which one can appreciate the degree of agreement between the two sets of data (acquired from the iPhone 4® and the IC3) for AM of motion.

Table 1 Anthropometric data and ETGUG total time score ( N = 5)
Full size table
Table 2 Kinematic data of sample ( N = 5)
Full size table
Table 3 Coefficient of Multiple Correlation (CMC) in the different phases of the ETGUG ( N = 5)
Full size table
Table 4 Intra-class correlations for IC3 peak acceleration and iPhone 4® peak acceleration
Full size table
Figure 2
figure2

Graphical illustration of the acceleration values in the different sub-phases of the ETGUG test. A. Accelerations in the standing phase. B. Accelerations in the sitting phase. C. Accelerations in the gait come phase.

Full size image
Figure 3
figure3

Bland-Altman plot for acceleration magnitude of motion, for the GG sub-phase with two devices.

Full size image

Discussion

We have investigated the reliability and concurrent criterion-related validity of the acceleration values along each of the three axes of motion acquired from an iPhone 4® during the performance of the ETGUG test by healthy elderly subjects, comparing them with the values acquired simultaneously with a standard validated laboratory device (IC3). There was a strong correlation between the two data sets. ICC is the most appropriate and widely used indicator to test the reproducibility of continuous measures. The results of our study, always above or equal to 0.80, prove that the iPhone 4 accelerations showed good levels of reproducibility. The Bland-Altman plots also showed high levels of agreement. The iPhone 4® thus proved to be reliable and valid for the identification of kinematic patterns in the performance of the ETGUG test by healthy elderly subjects.

To the best of our knowledge, the present study is the first designed to seek evidence for or against reliability and validity of the iPhone 4® as a tool for the analysis and identification of kinematic patterns in the accelerometry data acquired during the performance of the ETGUG test by healthy elderly subjects. A previous study [25] evaluated the implementation of the iPhone 3® as an accelerometer to quantify kinematic variables related to gait. It concluded that the device demonstrated sufficient validity and consistency for the different measurements considered.

However, unlike the present case, that study reports no design information and/or analyses to evaluate the device’s reliability and/or validity. Another study [26] evaluated the implementation of the iPhone 3® as an accelerometer to identify tremors in Parkinson’s sufferers. As in the previous case [25], again the document includes no design information and/or analyses to evaluate the reliability and/or validity prior to the possible characterization and identification of the Parkinsonian tremors reported in the study. Two recent studies [27, 28], evaluated the reliability and validity of a smartphone accelerometer. In both studies, the Smartphone were an Android phone, against the used in the present study (iPhone 4®).

As we presented in the results section, the worked out Bland-Altman plots obtained showed a solid tendency to stay at close to zero, especially on the y and x-axes, during the five phases of the ETGUG test (Figure 3). Nonetheless, there was a slight tendency to underestimate the data on the z-axis during the five phases of the test. The accumulated z-axis error never exceeded −0.5 m/s2, however (Figure 3). Using the method proposed by Bland & Altman [24], we would conclude that the two sensors are comparable in the measurement of accelerometry variables, since the differences found between the values recorded by the iPhone 4® and IC3 were minimal (Figure 3). Indeed, these differences were so small that they could well have been due to other methodological factors that may have biased the clinical result, such as the movement of the skin or clothing, or misalignment of the sensor.

The main contribution of the present study has been that the demonstration of the high levels of reliability and validity of the iPhone 4® in measuring the kinematic variables of human motion make this device potentially very interesting for eventual use in a clinical setting. To this end, it will be necessary to develop the appropriate software for its use. In the specific case of the analysis of the kinematics of the trunk in the ETGUG test with an iPhone 4®, it would be possible to measure absolute and averaged values of the speed of gait, the angular velocity during turns, acceleration along different axes of motion, acceleration in the different sub-phases of the test, and gait-related variables (cadence, stride length, etc.). The identification of the different sub-phases of the test could be performed using algorithms for segmenting the test applied to both devices. Further studies could be analyzed biggest samples and the sensitive of changes after an intervention.

Conclusions

We conclude that the inertial sensor incorporated in the iPhone 4® has the sufficient reliability and validity for the evaluation and identification of kinematic patterns in the ETGUG test. While analysis and interpretation of 3D kinematics data continue to be dauntingly complex, the iPhone 4® makes the task of acquiring the data relatively inexpensive and easy to use. In particular, it could be used in clinical practice or other environments of interest (such as patients’ homes, specialized centres, etc.), unlike other types of inertial sensors (e.g., the IC3) with their high costs and complex signal processing. The evidence clearly points to the suitability of the iPhone for the recognition of patterns of kinematics of the trunk during ETGUG testing, although this application could be extended to other functional activities.

References

  1. 1.

    Saber-Sheikh K, Bryant EC, Glazzard C, Hamel A, Lee R: Feasibility of using inertial sensors to assess human movement. Man Ther 2010, 15: 122–125. 10.1016/j.math.2009.05.009

  2. 2.

    Martínez-Ramírez A, Lecumberri P, Gómez M, Rodriguez-Mañas L, García FJ, Izquierdo M: Frailty assessment based on wavelet analysis during quiet standing balance test. J Biomech 2011, 44: 2213–2220. 10.1016/j.jbiomech.2011.06.007

  3. 3.

    Muir SW, Corea CL, Beaupre L: Evaluating change in clinical status: reliability and measures of agreement for the assessment of glenohumeral range of motion. N Am J Sports Phys Ther 2010, 5: 98–110.

  4. 4.

    Cuesta-Vargas AI, Galán-Mercant A, Williams JM: The use of inertial sensors system for human motion analysis. Phys Ther Rev 2010, 15: 462–473. 10.1179/1743288X11Y.0000000006

  5. 5.

    Mills PM, Morrison S, Lloyd DG, Barrett RS: Repeatability of 3D gait kinematics obtained from an electromagnetic tracking system during treadmill locomotion. J Biomech 2007, 40: 1504–1511. 10.1016/j.jbiomech.2006.06.017

  6. 6.

    Wong W, Wong M, Lo KH: Clinical applications of sensors for human posture and movement analysis: a review. Prosthet Orthot Int 2007, 31: 62–75. 10.1080/03093640600983949

  7. 7.

    Shaw M, Adam CJ, Izatt MT, Licina P, Askin GN: Use of the iPhone for Cobb angle measurement in scoliosis. Eur Spine J 2012,21(6):1062–1068. Published online Nov 9, 2011. doi:10.1007/s00586–011–2059–0 10.1007/s00586-011-2059-0

  8. 8.

    Galán-Mercant A, Cuesta-Vargas AI: Differences in trunk accelerometry between frail and non-frail elderly persons in functional tasks. BMC Res Notes 2014, 7: 100. 10.1186/1756-0500-7-100

  9. 9.

    Galán-Mercant A, Cuesta-Vargas AI: Differences in trunk accelerometry between frail and nonfrail elderly persons in sit-to-stand and stand-to-sit transitions based on a mobile inertial sensor. JMIR Mhealth Uhealth 2013, 1: e21. 10.2196/mhealth.2710

  10. 10.

    Galán-Mercant A, Cuesta-Vargas AI: Differences in trunk kinematic between frail and nonfrail elderly persons during turn transition based on a smartphone inertial sensor. Biomed Res Int 2013, 2013: 279197.

  11. 11.

    Zijlstra A, Goosen JHM, Verheyen CCPM, Zijlstra W: A body-fixed-sensor based analysis of compensatory trunk movements during unconstrained walking. Gait Posture 2008, 27: 164–167. 10.1016/j.gaitpost.2007.02.010

  12. 12.

    Zijlstra W, Hof AL: Assessment of spatio-temporal gait parameters from trunk accelerations during human walking. Gait Posture 2003, 18: 1–10.

  13. 13.

    Bebek O, Suster MA, Rajgopal S, Fu MJ, Huang X, Çavuşoǧlu MC, Young DJ, Mehregany M, van den Bogert AJ, Mastrangelo CH: Personal navigation via high-resolution gait-corrected inertial measurement units. IEEE Trans Instrum Meas 2010, 59: 3018–3027.

  14. 14.

    Apple iPhone Specs [http://www.apple.com/iphone/specs.html]

  15. 15.

    Kreighbaum E, Barthels K: Biomechanics: A Qualitative Approach for Studying Human Movement. 4th edition. Boston: Benjamin Cummings; 1995.

  16. 16.

    Hamill J, Knutzen KM: Biomechanical Basis of Human Movement. 2nd edition. Baltimore: Lippincott Williams & Wilkins; 2003.

  17. 17.

    Higashi Y, Yamakoshi K, Fujimoto T, Sekine M, Tamura T: Quantitative evaluation of movement using the timed up-and-go test. IEEE Eng Med Biol Mag 2008, 27: 38–46.

  18. 18.

    Mathias S, Nayak US, Isaacs B: Balance in elderly patients: the “get-up and go” test. Arch Phys Med Rehabil 1986, 67: 387–389.

  19. 19.

    Wall JC, Bell C, Campbell S, Davis J: The timed get-up-and-go test revisited: measurement of the component tasks. J Rehabil Res Dev 2000, 37: 109–113.

  20. 20.

    Najafi B, Aminian K, Loew F, Blanc Y, Robert PA: Measurement of stand-sit and sit-stand transitions using a miniature gyroscope and its application in fall risk evaluation in the elderly. IEEE Trans Biomed Eng 2002, 49: 843–851. 10.1109/TBME.2002.800763

  21. 21.

    Salarian A, Zampieri C, Horak FB, Carlson-Kuhta P, Nutt JG, Aminian K: Analyzing 180° turns using an inertial system reveals early signs of progress in Parkinson’s Disease. Conf Proc IEEE Eng Med Biol Soc 2009, 2009: 224–227.

  22. 22.

    Ferrari A, Cutti AG, Cappello A: A new formulation of the coefficient of multiple correlation to assess the similarity of waveforms measured synchronously by different motion analysis protocols. Gait Posture 2010, 31: 540–542. 10.1016/j.gaitpost.2010.02.009

  23. 23.

    Cohen L: Statistics for Social Scientists. Harper & Row; 9780063182202, from Anybook Ltd. [https://www.apple.com/lae/iphone-4s/specs/]

  24. 24.

    Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1: 307–310.

  25. 25.

    Lemoyne R, Mastroianni T, Cozza M, Coroian C, Grundfest W: Implementation of an iPhone as a wireless accelerometer for quantifying gait characteristics. Conf Proc IEEE Eng Med Biol Soc 2010, 2010: 3847–3851.

  26. 26.

    LeMoyne R, Mastroianni T, Cozza M, Coroian C, Grundfest W: Implementation of an iPhone for characterizing Parkinson’s disease tremor through a wireless accelerometer application. Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE 2010, 4954–4958. doi:10.1109/IEMBS.2010.5627240

  27. 27.

    Nishiguchi S, Yamada M, Nagai K, Mori S, Kajiwara Y, Sonoda T, Yoshimura K, Yoshitomi H, Ito H, Okamoto K, Ito T, Muto S, Ishihara T, Aoyama T: Reliability and validity of gait analysis by android-based smartphone. Telemed J E Health 2012, 18: 292–296. 10.1089/tmj.2011.0132

  28. 28.

    Mellone S, Tacconi C, Chiari L: Validity of a smartphone-based instrumented timed up and go. Gait Posture 2012, 36: 163–165. 10.1016/j.gaitpost.2012.02.006

Download references

Acknowledgements

The authors would like to thank all participants and collaborating staff who took part in the research.

This research was partially funded by grants from OTRI-UMA (ref 806/423505-1).

Author information

Affiliations

  1. Departamento de Psiquiatría y Fisioterapia, Facultad de Ciencias de la Salud, Universidad de Málaga, Andalucia Tech, Cátedra de Fisioterapia y Discapacidad, Instituto de Biomedicina de Málaga (IBIMA), Grupo de Clinimetria (AE-14), Av/ Arquitecto Peñalosa s/n (Teatinos Campus Expansion), 29009, Málaga, Spain

    • Alejandro Galán-Mercant
    • , María T Labajos-Manzanares
    •  & Antonio I Cuesta-Vargas

  2. Departamento de Medicina Preventiva, Facultad de Medicina, Universidad de Málaga, Andalucia Tech, Malaga, Malaga, Spain

    • Francisco Javier Barón-López

  3. School of Clinical Sciences of the Faculty of Health at the Queensland, University of Technology, Brisbane, Australia

    • Antonio I Cuesta-Vargas

Authors

  1. Search for Alejandro Galán-Mercant in:

  2. Search for Francisco Javier Barón-López in:

  3. Search for María T Labajos-Manzanares in:

  4. Search for Antonio I Cuesta-Vargas in:

Corresponding author

Correspondence to Antonio I Cuesta-Vargas.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AIC-V has made contribution to conception of this study. AG-M and AIC-V participated in the collect of data. AIC-V, AG-M and FJB-L participated in the analysis and interpretation of data and were involved in drafting the manuscript or revising it critically for important intellectual content. All the authors have given final approval of the version to be published.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Inertial sensor
  • Smartphone
  • iPhone
  • Older adult
  • Validation

BioMedical Engineering OnLine

ISSN: 1475-925X

Contact us