Predicting proximity with ambient mobile sensors for non-invasive health diagnostics

2015·Arxiv

Abstract

Abstract

Modern smart phones are becoming helpful in the areas of Internet-Of-Things (IoT) and ambient health intelligence. By learning data from several mobile sensors, we detect nearness of the human body to a mobile device in a three-dimensional space with no physical contact with the device for non-invasive health diagnostics. We show that the human body generates wave patterns that interact with other naturally occurring ambient signals that could be measured by mobile sensors, such as, temperature, humidity, magnetic field, acceleration, gravity, and light. This interaction consequentially alters the patterns of the naturally occurring signals, and thus, exhibits characteristics that could be learned to predict the nearness of the human body to a mobile device, hence provide diagnostic information for medical practitioners. Our prediction technique achieved 88.75% accuracy and 88.3% specificity.

I. INTRODUCTION

The importance of predicting with mobile sensors can be seen in various mobile apps that help people’s lifestyle. In most cases, the acceleration sensor in mobile devices have been used to capture activity patterns using the x, y and z coordinate values generated by the sensor. This has given substantial accuracy, especially for activities that generate vivid alternating patterns, such as running and jogging [1]. However, it is rather unclear whether other sensors could as well contribute to the prediction, and perhaps, the combination of two or more sensors could lead to better prediction of different activities. In this paper, we predict a novel activity that has to do with the nearness or proximity distance of a human body to the mobile device without physically touching or holding the mobile device. As such, for the purpose of this work, we refer to proximity distance recognition as “nearness recognition”, and hence, will be used consistently for the rest of this paper. Human-mobile nearness recognition is important and could significantly change the way humans communicate with their mobile devices. Nearness recognition could be used in the area of ambient health intelligence, whereby human health information such as wellness or exposure to environmental hazards can be autonomously detected by a mobile app. For example, [2] used the ambient temperature and pressure sensors to measure a user’s physiological conditions and disorders in hazardous environments. High humidity can cause mold and fungus to grow and affect people with asthma and allergies, while in low humidity, dry skin and eyes itchiness could develop [3]. Thus, detecting these ambient changes around humans could potentially prevent health problems.

As such, we perform experiments by collecting data from steady and non-steady spaces and perform several data transformations to show that both exhibit different patterns or signatures, and thus can be studied and used as features to train machine learning algorithms. Second, we predict that a human is near to a mobile device by up to 88.75% accuracy (88.3% sensitivity) and then collect several ambient information for diagnostic purposes as shown in Figure 1.

Fig. 1. Using mobile ambient sensors for health diagnostics.

The rest of this paper is organized as follows. Related works are discussed in Section II; steady and non-steady spaces in Section III; nearness recognition in Section IV; experiments and results in Section V; and conclusion in Section VI.

II. RELATED WORK

Most related works have performed activity recognition for healthy lifestyle and fitness using the acceleration sensor [1], [4]. For example,[1] performed activity recognition using the acceleration sensor on Android based mobile device. Several activities including walking, jogging, standing, sitting, and ascending or descending stairs were predicted having learned a set of transformed features. Acceleration data was transformed into 43 learn-able features. Multilayer perceptron has the best predictive accuracy of 91.7% followed by J48 with 85.1%. Our work differs from [1] as we predict nearness or noticeable proximity of the human body to a mobile device. More recently, proximity detection has been introduced for creating several non-invasive health diagnostic tool for the health industry using Body Area Network (BAN) techniques [5]. Our work falls in this category, and more importantly, novel in the sense that we do not use only one sensor point

III. STEADY AND NON-STEADY SPACES

Fig. 2. A representation of a steady three-dimensional space having no human body interaction at a time interval

Fig. 3. A representation of a non-steady three-dimensional space with human body interaction at a time interval

A. Steady Space

Fig. 4. An example of a steady three-dimensional space sinusoidal output for a pressure sensor with T=60s.

B. Non-Steady Space

We identify a non-steady space as a three-dimensional steady space that enters into transient as a result of the extra oscillation and radiation introduced to the steady space with an entry of a human body. Thus, Figure 5 shows a non-steady three-dimensional space, again with the sinusoidal output of a pressure sensor within a 60 seconds period (i.e. T = 60s).

Fig. 5. An example of non-steady three-dimensional space sinusoidal output for a pressure sensor with T = 60s.

Thus, we define the characteristic of a non-steady space as

where H is the extra human oscillation or signal introduced to the set of existing sinusoidal signals,is the transient component introduced as a result of the introduction of is the frequency of each sinusoid, and is a normalization factor for the sinusoids.

IV. NEARNESS RECOGNITION

Having defined the characteristics of steady and non-steady spaces, we propose to learn the characteristics in order to detect human-mobile nearness. We propose that a human is likely to be near or in a close proximity to a mobile device when the condition in Equation 2 is satisfied. Moreover, signals that are characterized by Equation 2, have also been characterized by a similar and popular equation in speech signal processing [8]:

where g(t) is the random amplitude, h(t) is a noise component, and is defined as the transient frequency. In order to detect human-mobile nearness, one could learn the , and h(t) components [9]. In addition, research have shown that the human body is capable of generating waveforms as a result of the endogenous electromagnetic fields which radiate from the human body to the three-dimensional space [10], [11]. In a recent research by [12], it was shown that the human body could significantly alter the electromagnetic waves that are generated by sensors, thereby leading to noisy wave pattern.

A. Data Collection

We developed an Android application to log several sensor readings from a Samsung Galaxy S4 mobile device in a controlled environment. The sensors include, Pressure, Gravity, Accelerometer, Ambient Temperature, Relative Humidity, Magnetometer, Gyroscope, Ambient Light, and Rotation Vector. The data logged per one reading instance include the X,Y,Z coordinates of each sensor and the reading timestamp in milliseconds.

Our controlled environment is a designated behavioral lab, which was designed for the purpose of conducting behavioral experiments relating to humans. Thus, we regard the behavioral lab as a three-dimensional space as discussed in Section III. Since we propose to learn both steady and non-steady spaces, we performed data collection in two phases.

In phase 1, a three-dimensional steady space is simulated by starting the data collection app with the mobile device placed on a table at the common area within the lab. In this phase, no human presence is required in the lab. We then log readings from the 9 sensors over a period of 60 minutes.

In phase 2, we simulated a three-dimensional non-steady space by maintaining the setup in phase 1 and include a human subject to walk or sit around the mobile device up to a distance of 1 meter from it over a period of 10 minutes while logging the sensor readings.

Phase 2 was performed with 20 different participants who are regular mobile phone users. Furthermore, the total reading instances per phase from each human subject was divided into several reading windows. Each 10 minute period in a phase, generated approximately 6000 reading instances on average. We limit each reading window to a maximum of 512 in order to allow the sinusoidal outputs generate enough unique and learn-able characteristics as suggested in [9].

B. Data Transformation

It is essential to transform the raw time-series readings to generate different learn-able features [9]. As such, we use several statistical and numerical techniques to transform the data for each sensor.

where N is the number of readings in each coordinate, r is a reading value, and is the reading window set to 512.

• Standard Deviation (SD) [1]: the standard deviation for each coordinate X,Y, and Z over the total number of reading instances in a reading window.

where N is the number of readings in each coordinate, r is a reading value, and is the mean of the reading values.

• Entropy(): the entropy for each coordinate X,Y, and Z over the total number of reading instances in a reading window. Entropy measures the level of uncertainty in the sample data, where the entropy is minimal for a less random data and larger for a more random data [13].

where X,Y,Z are sets of reading instances for the coordinates, e is an exponential function, and is the variance.

• Mean Absolute Difference (MAD) [1]: For each X,Y,Z coordinates in a sensor, we compute the mean absolute difference as the mean of the difference between the values in each coordinate and the mean value for that coordinate.

• Mean Resultant Weight(MRW) [1]: The weight is computed as the square root of the sum of the square of each value in the X,Y,Z coordinates divided by the number of reading instances in the reading window.

where x, y and z are reading values from X,Y,Z coordinates, and is the reading window.

• Gaussian Coverage Strength (GCS): Gaussian distribution has been successfully used in signal processing for interpreting random variables [14]. Similarly, we transformed the values of the X, Y, Z coordinates with the Gaussian’s Probability Density Function (PDF) [15], and the Cumulative Distribution Function (CDF) [16], to represent the Gaussian distributions, respectively. The PDF is computed as follows:

where is the standard deviation, e is an exponential function, is each reading, is the mean, and is the variance. Similarly, we compute the CDF as follows:

where erf is the Gaussian error function for each reading [17], thus computed as:

Figures 6 shows the differences in the Gaussian transformations (CDF) of the X-axis of a magnetometer sensor readings.

Fig. 6. Difference between the CDF transformation for the X-axis of a magnetometer sensor readings from steady and non-steady spaces.

Hence, the GCS is computed as the difference between the maximum and minimum values of each of the Gaussian distributions for X, Y, Z coordinates as follows:

where is the Gaussian distribution in PDF or CDF.

where pk is a peak in the sinusoid and is the reading window as discussed earlier.

ADPI = (14) where is the mean of the magnitudes generated by the FFT. Note that we did not compute the interval between the distinct peaks as the difference between the “log” of the peaks as in Equation 13. This is because the FFT generates relatively smooth graphs or patterns (see Figure 7), which makes the magnitudes of its sinusoids very small [9], and thus, generates peaks that are very close to the origin. As such, the log of such peaks could lead to ambiguous intervals. Since the CDF generates visible regular patterns with more distinct peaks (see figures 6), our FFT-ADPI is computed on the CDF function over X,Y,Z axis of each sensor.

Fig. 7. FFT-CDF transformation for the X-axis of a magnetometer sensor readings from steady and non-steady spaces over a 512 reading window.

C. Features Set

Table I shows the combined features set resulting from the transformation processes. The set will be used in training different machine learning algorithms for predicting the nearness of a human to a mobile device.

V. EXPERIMENTS

We performed experiments by learning three different Ma- chine Learning (ML) classifiers (algorithms) using the WEKA ML platfom with default settings [18]. The classifiers consist of, Sequential Minimum Optimization (SMO), which is a variant of Support Vector Machines (SVM), Na¨ıve Bayes (NB), and Neural Networks with Multilayer Perceptron (NN-MP).

For learning the classifiers, we used a meta classification approach that combines attribute selection techniques to reduce the features space while discarding the less contributing features. As such, we used the InfoGain attribute selection algorithm, together with the Ranker algorithm [19].

Our dataset1 consists of 1000 instances comprising of 500 instances for steady-space (labeled control), 500 instances for non-steady space (labeled near).

TABLE I. COMBINED FEATURES SET FROM EACH SENSOR FOR LEARNING ML ALGORITHMS

A. Results and Discussion

In the first stage, we evaluated the prediction performance of the three ML classifiers on the control and near categories with random 60% training and 40% testing set, see Table II.

In the second stage of our experiment, we evaluated the contributions of each sensor to predicting the near category with the SVM-SMO classifier using a 60%-40% split on the 1000 instances. This is to know which sensor(s) are more effective for prediction. As such, we removed each sensor’s readings one at a time and then classify with every other sensors, see Table III.

Using the SVM-SMO 79.4% F-measure as baseline (see Table II), we identified which sensor did not improve the performance of the classifier. If a sensor is removed, and the performance of the model increases more than 79.4% Fmeasure, then that sensor is considered as not improving the performance of the model.

Further, we evaluated by using SVM-SMO with 60%-40% split to compare the performance of the model with all the 9 sensors to the model with just the 5 sensors that gave better performance (i.e. light, gravity, accelerometer, rotationvector, and temperature). We then compute the sensitivity and 1-specificity of the two models for comparison. Table IV shows the comparison for the two models. The 5-sensor model clearly showed better sensitivity of 88.3% for performing the nearness recognition task [10], [12].

Furthermore, we compared between the Receiver Operator Characteristic (ROC) curves of the two models [20]. Figure 8 shows the ROC curve for a model with all 9 sensors and Figure 9 shows the ROC curve for a model with the 5 sensors. The 5-sensor model shows better Area Under Curve (AUC) of 0.87 compared to 0.80 for 9 sensors.

VI. CONCLUSION AND FUTURE WORK

We performed human-mobile nearness recognition for non- invasive health diagnostic purposes by analyzing and learning data from 9 different sensors on a mobile device. Several data transformation were done to learn the unique characteristics of both steady and non-steady three-dimensional spaces for

Fig. 8. ROC Curve (AUC = 0.8) for SVM-SMO 9 sensors.

Fig. 9. ROC Curve (AUC = 0.87) for SVM-SMO 5 best sensors.

predicting human nearness to a mobile device. The limitation of this work lies in the fact that test data consists of sensor readings that are limited to a controlled environment. It could be better to consider several uncontrolled environments including a public space which might contain several ambient noise signals at different weather and day times. Also, it could be challenging to execute the complex state-of-the-art ML algorithms on the devices. As such, collected ambient sensors data could be sent to a remote server in real-time, where the trained model can be used for prediction and then send the output back to the device. In the future, we plan to detect human breathing rate using the same technique and include a diagnostic web interface for medical practitioners.

TABLE II. 60%-40% CLASSIFIERS’ PERFORMANCE ON STEADY (CONTROL) AND NON-STEADY (NEAR) SPACES USING ALL 9 SENSORS.

TABLE III. SVM-SMO PERFORMANCE ON THE CONTRIBUTIONS OF EACH SENSOR TO PREDICTING THE near CATEGORY.

TABLE IV. SENSITIVITY AND 1-SPECIFICITY COMPARISON BETWEEN THE 5-SENSOR AND ALL-SENSORS MODELS.

ACKNOWLEDGEMENT

REFERENCES

[1] J. R. Kwapisz, G. M. Weiss, and S. A. Moore, “Activity recognition using cell phone accelerometers,” ACM SigKDD Explorations Newsletter, vol. 12, no. 2, pp. 74–82, 2011.

[2] R. Jafari, A. Encarnacao, A. Zahoory, F. Dabiri, H. Noshadi, and M. Sarrafzadeh, “Wireless sensor networks for health monitoring,” in Mobile and Ubiquitous Systems: Networking and Services. The Second Annual International Conference on. IEEE, July 2005, pp. 479–481.

[3] B. Hoffmann, H. Luttmann-Gibson, A. Cohen, A. Zanobetti, C. de Souza, C. Foley, H. H. Suh, B. A. Coull, J. Schwartz, M. Mittleman et al., “Opposing effects of particle pollution, ozone, and ambient temperature on arterial blood pressure,” Environmental health perspectives, vol. 120, no. 2, p. 241, 2012.

[4] T. Brezmes, J.-L. Gorricho, and J. Cotrina, “Activity recognition from accelerometer data on a mobile phone,” in Distributed computing, arti-ficial intelligence, bioinformatics, soft computing, and ambient assisted living. Springer, 2009, pp. 796–799.

[5] M. Chen, S. Gonzalez, A. Vasilakos, H. Cao, and V. C. Leung, “Body area networks: A survey,” Mobile networks and applications, vol. 16, no. 2, pp. 171–193, 2011.

[6] O. I. Okoro, “Steady and transient states thermal analysis of a 7.5-kw squirrel-cage induction machine at rated-load operation,” Energy Conversion, IEEE Transactions on, vol. 20, no. 4, pp. 730–736, 2005.

[7] H. Mu, W.-S. Gan, and E.-L. Tan, “A psychoacoustic bass enhancement system with improved transient and steady-state performance,” in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 141–144.

[8] A. Swami, “Multiplicative noise models: Parameter estimation using cumulants,” Signal processing, vol. 36, no. 3, pp. 355–373, 1994.

[9] B. Mu, Y. Li, and J. E. Seem, “Discrimination of steady state and transient state of extremum seeking control via sinusoidal detection,” in ASME 2013 Dynamic Systems and Control Conference. American Society of Mechanical Engineers, 2013, pp. 36A006–36A006.

[10] M. H. Haron, M. N. Taib, M. S. A. M. Ali, M. M. Yunus, and S. Z. A. Jalil, “Statistical analysis on human body radiation points,” in Control and System Graduate Research Colloquium (ICSGRC), 2012 IEEE. IEEE, 2012, pp. 100–105.

[11] N. Cho, J. Yoo, S.-J. Song, J. Lee, S. Jeon, and H.-J. Yoo, “The human body characteristics as a signal transmission medium for intrabody communication,” Microwave Theory and Techniques, IEEE Transactions on, vol. 55, no. 5, pp. 1080–1086, 2007.

[12] M. Mackowiak, C. Oliveira, C. Lopes, and L. M. Correia, “A statistical analysis of the influence of the human body on the radiation pattern of wearable antennas,” in Personal Indoor and Mobile Radio Communications (PIMRC), 2011 IEEE 22nd International Symposium on. IEEE, 2011, pp. 2214–2218.

[13] R. M. Gray, Entropy and information theory. Springer, 2011, vol. 1. [14] M. A. Davenport, P. T. Boufounos, M. B. Wakin, and R. G. Baraniuk, “Signal processing with compressive measurements,” Selected Topics in Signal Processing, IEEE Journal of, vol. 4, no. 2, pp. 445–460, 2010.

[15] E. Parzen, “On estimation of a probability density function and mode,” The annals of mathematical statistics, pp. 1065–1076, 1962.

[16] N. Smirnov, “Table for estimating the goodness of fit of empirical distributions,” The Annals of Mathematical Statistics, pp. 279–281, 1948.

[17] S.-H. Chang, P. C. Cosman, and L. B. Milstein, “Chernoff-type bounds for the gaussian error function,” Communications, IEEE Transactions on, vol. 59, no. 11, pp. 2939–2944, 2011.

[18] M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, “The weka data mining software: an update,” ACM SIGKDD explorations newsletter, vol. 11, no. 1, pp. 10–18, 2009.

[19] M. Makrehchi and M. S. Kamel, “Feature ranking fusion for text classifier,” Intelligent Data Analysis, vol. 16, no. 6, pp. 879–896, 2012.

[20] M. Majnik and Z. Bosni´c, “Roc analysis of classifiers in machine learning: A survey,” Intelligent Data Analysis, vol. 17, no. 3, pp. 531– 558, 2013.

designed for accessibility and to further open science