Retrofitting an existing building often reduces its energy consumption and particularly the heating and cooling costs. To assess the effectiveness of the retrofit, auditors perform on-site tests to gauge the insulation and infiltration quality of a house. However, such tests are expensive and intrusive, and thus cannot be carried out continuously. The proliferation of smart thermostats such as NEST and Ecobee [23], and their acceptance and deployment in home environments are opening up new research avenues. In the near term, we envision a self-adaptive and programmable thermostat, that can seamlessly receive environmental data from the indoor and outdoors, and residents’ activities, to model the inherent thermal characteristics of the building. Such a dynamic and adaptive smart thermostat will provide an early assessment of the insulation and leakage, and thus help promote energy sensitive actions and maintain comfort levels.
Physicists have studied methods for modeling buildings’ thermal conditions by way of several measurable parameters [10, 39]. In these models, the thermal dynamics of a building are represented by an RC-circuit, due to system equivalence, which allows us to derive a set of stochastic differential equations that describe the thermal patterns. The composite parameters resistance (R) and capacitance (C) of the circuit are analogous to the buildings’ insulation (and to some extent the infiltration), and the thermal mass, respectively. Building quality measurement uses standardized metrics such as R-value (or U-value) to measure insulation and to measure infiltration. The thermal mass of a house is the ability of a material to absorb and store heat energy. Optimization based techniques [16, 34] are popularly used to estimate the parameters, where the objective is to reduce the error between observed and predicted values. However, most approaches do not simultaneously consider two key factors that are common in the real world:
• Stochasticity of the building parameters: The optimizationbased methods are effective for fitting a model to data, but
cannot provide a margin of error on the estimation. This is important as stochasticity arises due to several unaccounted factors, including human activity and home appliance usage, which cannot be directly quantified.
• Presence of prior knowledge: It is common knowledge that older buildings have poor insulation. Studies [2] show that the average house size has increased with time, and that larger homes typically have better insulation quality. By incorporation of prior knowledge such as , these intuitions about a building’s condition can potentially increase the accuracy of the estimated parameters. To address these concerns, the Bayesian approach is a natural and simple way to incorporate prior knowledge in the building thermal modeling framework which also approximates the factors influencing the model dynamics. It allows for comparisons among multiple candidate models instead of performing binary hypothesis tests on a single model. The Bayesian posterior distribution plays the role of Occam’s razor, effectively penalizing an increase in model complexity, such as adding variables, while rewarding improvements in fit. However, the existing Bayesian approaches have a few notable limitations: (i) Bayesian inference of the parameters is primarily performed with Markov Chain Monte Carlo (MCMC) algorithms [13, 15] which take a long time to converge, and thus are not well suited for the case where model complexity and/or data size increase. (ii) A majority of previous works applied uninformed normal priors and do not evaluate the effect of prior selection on model performance. As such the full benefit of a Bayesian statistical approach is not utilized. (iii) Finally, most studies limit their scope to a single seasonal period, particularly in the winter when residents use the HVAC in heating mode, and do not study how the model parameters estimated in one season can be used to monitor the house longitudinally.
Figure 1: Distribution of R-values of houses
To investigate these shortcomings and their resolution, in this paper we present a systematic study of Bayesian approaches to the modeling of buildings’ thermal dynamics. We propose a generalized Bayesian State Space Model (BSSM) that can combine physics-based thermal models into a probabilistic framework. We further embed prior intuition and knowledge regarding buildings into the model based on subjective beliefs. For example, in Figure 1, the probability densities of the R-values of homes built before the year 2000 differ depending on their size, in this case whether their area is less than 2000 square feet. We show how to incorporate such knowledge by effective prior selection. However, such priors are not conjugate to the likelihood and solutions cannot be computed analytically. We thus perform inference based on algorithms that do not depend on conjugacy, such as Automatic Differentiation Variational Inference, and show that the buildings’ parameters can be estimated effectively with such an approximate approach. We analyze the effect of learning parameters from one season and use transfer learning to estimate the thermal dynamics in a different season when the HVAC is used in a different mode. We present two case studies on real data traces to show the effectiveness of the Bayesian approach, and the effects of prior selection and transfer learning across seasons.
Key Contributions: Our innovations and results provide evidence that the Bayesian approach to modeling a building’s thermal characteristics is valuable. The primary contributions of our work are as follows.
• Bayesian State Space Model: We propose a Bayesian state-space model for estimating buildings’ thermal parameters. Unlike previous methods [3, 20, 26, 28] which use point estimates, our Bayesian model is capable of incorporating beliefs using non-conjugate priors, and managing uncertainty in the parameters. We inferred the model parameters within a 95% credible interval with a Mean Field Variational Approximation, and show that the estimates are as accurate as that of a more time-consuming MCMC approach.
• Interpretable assessment of the generative model: We explored the generative characteristics of the model by Monte-Carlo simulation and forecasting, which helps understand the causal physical process that describes the thermal behavior of a house. We also tested the quality of the models by forecasting indoor temperature with the learned building parameters.
• Effects of transfer learning & prior selection: We proposed a transfer learning based approach by learning buildings’ parameters in summer, when HVAC is typically operational in cooling mode, and used it to aid fitting the data in seasons when HVAC is not used or operates in heating mode. We propose a systematic approach to prior selection to incorporate beliefs about the buildings’ characteristics in the model and conducted rigorous experiments to study their behavior.
The rest of the paper is structured as follows. In Section 2 we discuss related work on building parameter identification and Bayesian estimation. In Section 3 we propose the Bayesian State Space model for building parameter identification. In Section 4 we present two case studies and provide analysis of the model and finally conclude in Section 5.
In this section, we review the previous works in three major related areas – parametric modeling of buildings’ thermal dynamics, techniques for parameter estimation, and a brief review of techniques for Bayesian inference.
to understand a building’s quality with few parameters. There are three approaches for modeling buildings’ thermal dynamics –
models all physical processes of a building [19, 22] by formulating exact system dynamics. Such deterministic models are difficult to construct as the exact dynamics are often unavailable and due to the presence of noise in the data, arising from unaccounted factors. Black-box modeling approaches, such as regression, neural networks etc., are applied to model indoor temperature as a function of observed data, much like outdoor temperature [33]. However they do not describe the generative process and thus isn’t effective for interpretation. A gray-box model is a combination of prior physical knowledge and statistical approaches. The heat dynamics of the building was formulated using several equivalent models of varying complexity in [3], that estimated the insulation and the thermal mass of a building. An extension of such an approach included the effect of wind speed on infiltration is proposed in [28], and expansionary effect of air with temperature changes was modeled in [38].
Parameter estimation for the gray-box model was performed in [26] by maximum likelihood estimation (MLE) and maximum a posteriori estimation (MAP). An extension of the approach [14], chose a simpler model to represent the dynamics and learned the residuals separately with Gaussian priors. Other works have focused on optimization based techniques [28, 34], where the objective is to minimize deviation between measurements and predictions from the model. Although, these approaches are simpler, they do not incorporate noise estimation in the equations. Alternatively, a Bayesian approach offers a natural way of dealing with parameter uncertainty in a state space model [13, 15]. Bayesian methods have been widely used for the closely related problem of building energy modeling [17, 21, 24, 29], but have been less well studied in the context of thermal modeling for buildings [3, 35]. A majority of previous works have applied the Metropolis-Hastings algorithm for Bayesian inference [17, 21, 24, 29, 35] which is ill-fitted for the specific problem as it takes a large number of steps to achieve convergence. The No U-Turn sampler (NUTS) showed better results [9] for parameter estimation in a related problem, building energy models, so we choose the latter.
Bayesian Inference, as performed in the previous works, used uninformed uniform priors and/or Normal priors for the model parameters [3, 35]. Such assumptions do not hold true as the parameters typically have non-Normal distributions. Non-normal priors do not have conjugacy with the likelihood, and analytical solutions of the posterior distribution are not possible. In such cases, algorithms that do not rely on conjugacy become important such as MCMC and Variational Inference. MCMC algorithms are capable of overcoming this problem but are time-consuming. Alternatively, Variational Inference [4, 30] is an approximate inference that derives a lower bound for the marginal likelihood which can be optimized using stochastic gradient descent. In our experiments, we use the Mean Field Variational Inference and find that it provides similar parameter estimation to MCMC algorithms.
We follow the iterative modeling approach known as 6], shown in Fig. 2, for estimating buildings’ thermal parameters. The process starts with a collected and pre-processed dataset. We propose a Bayesian state space model to frame the problem and estimate parameters using MCMC and Variational Inference. Finally, we test for model convergence and measure the goodness of fit.
Figure 2: Box’s Loop
3.1 Bayesian Linear State Space Model
The generalized linear state space models consist of a sequence of M-dimensional observations (, ... ), assumed to be generated from latent D-dimensional states X = (, ... ) and control variables). The dataY is generated by the following state space equations:
where Eqn. 1 is the state evolution equation (analogous to HMM state transition) and Eqn. 2 is the observation or measurement equation (emission probability). The overall state transition probability is given as
whereis an auxiliary initial state with meanand a precision matrix of (the matrix inverse of the covariance matrix). The emission probability is given by
Here Y is a normal distribution with mean CX and a covariance matrix with. The covariance matrix R is a diagonal matrix as the noise is independent of the observed states Y. The graphical nature of the BSSM model is shown in Fig 3, which is analogous to an Input-Output HMM [5].
Figure 3: Bayesian State Space Model
3.2 Problem Formulation
We use an example to illustrate how to formulate a building’s thermal equations and incorporate them into the proposed state space model framework. Figure 4 shows an equivalent circuit that describes the thermal dynamics of a house.
Figure 4: TiTe circuit model
In this example, called the TiTe model, we assume that there are two latent state spaces Ti and Te that describes the indoor and envelope temperatures. The thermal dynamics is represented by a set of stochastic differential equations derived from the equivalent assumption. The equations of the process are given by:
where t is the time, is the thermal resistance between the interior and the building envelope, is the thermal resistance between the building envelope and the ambient air, is the heat capacity of the interior, is the heat capacity of the building envelope, is the energy flux from the heating system, is the effective window area, is the energy flux from solar radiation, is the ambient air temperature, and are standard Wiener processes with variances respectively, where t is the point in time of a measurement. is the indoor temperature, is the measured interior and is the measurement error, which is assumed to be a Gaussian white noise process. Converting the differential equations (Eqns 5–7) as difference equations we get the transition and emission matrix form as:
Eqn 8 is the state transition of the dynamic system and is equivalent to the general form as presented in Eqn 1 that gives us the transition probability, i.e (Eqn 3). Similarly, Eqn 9 is equivalent to the measurement equation provided by Eqn 2 that gives us the emission probability (Eqn 4). In Eqn 8, the first two matrices models the physical dynamics and the third matrix is the measure of stochasticity in the data. Similarly, in Eqn 9, the first matrix is the measurement equation and is the error in measurement. In the base case, we assume an uninformative Gamma prior over the model parameters and the hyper-parameters of the gamma distribution are automatic relevance determination (ARD) parameters, which prune out components that are not significant enough. We provide broad priors to the gamma distribution by setting the shape and rate to a very small value [4]. Thus parameters are given as , , where is a very small value. We also impose a bound on the parameters, which can help by limiting the parameters to certain reasonable ranges. We formulate other instantiations of the physical models in the case studies presented in Section 4.1.2.
3.3 Bayesian Inference
Bayesian inference recovers the posterior distribution over parameters and latent variables of the model, which can hence be used to perform prediction. While exact solutions can be achieved for some basic models, computing the posterior distribution is generally an intractable problem, in which case approximate inference is needed.
Markov chain Monte Carlo (MCMC) algorithms are a widely applied method for approximate inference, which aims to estimate the posterior using a collection of samples drawn from an appropriate Markov chain. Hamiltonian Monte Carlo (HMC) [32] algorithms such as NUTS avoid the random walk behavior by taking a series of steps informed by first-order gradient information. These features allow it to converge to high-dimensional target distributions much more quickly than simpler methods such as random walk Metropolis Hastings [41]. The No U-Turn Sampler (NUTS) [18] uses a recursive algorithm to build a set of likely candidate points that span a range of the target distribution, stopping automatically when it starts to backtrack and retrace its steps, which prevents the revisiting of previously explored paths. In this work, we select the NUTS sampler for inference.
Another option is Variational Inference, which is a class of algorithms that are deterministic alternatives to MCMC. This reduces inference tasks to an optimization problem [7]. In a probabilistic latent model setting, Y is the observed data, X is the latent variable space and the model parameters. An approximating distribution over the latent variables and parameters, called the variational distribution, is constructed to approximate the posterior. The objective is to reduce the “gap” between the variational and the posterior distribution. This gap is given by the Kullback-Leibler divergence, which is the relative entropy between the two distributions, given as:
In Eqn 10, is independent of the distribution minimizing Eqn 10 is equivalent to maximizing:
Using Jensen’s inequality, L(q) can be shown to be a lower bound on log p(Y), and is hence known as the Evidence Lower Bound (ELBO). To make inference tractable, we make simplifying assumptions on q. The most commonly used assumption is the mean-field approximation, which assumes that the latent variables are independent of each other. Thus the variational distribution with N latent variables is assumed factorized as Traditionally, a Variational Inference algorithm requires developing and implementing model specific optimization routines. Automatic Differentiation Variational Inference (ADVI) [27] proposes an automatic solution to posterior inference. ADVI first transforms the model into one with unconstrained real-valued latent variables. It then recasts the gradient of the variational objective function as an expectation over q. This involves the gradient of the log of the joint likelihood with respect to the latent variable is computed using reverse-mode automatic differentiation [31]. This gradient term is applied to optimize the parameters using a stochastic gradient descent approach.
It is important to note the underlying assumptions of ADVI. It factors the posterior distribution such that all the state variables are statistically independent, following the mean-field approximation. For a highly correlated posterior, e.g. in state space models, where the intuition is that will be highly correlated with , the mean-field assumption is rather unrealistic. The method can still work well in practice, however, as the (uncorrelated) q is fit to the (correlated) p, thereby exploiting dependencies, even though they are not ultimately encoded in q. NUTS, on the other hand, is very good at exploring a correlated, high-dimensional distribution, but can suffer in both run-time and convergence speed versus ADVI. We empirically evaluate the effectiveness of these approximations by comparing the parameters inferred by both the methods.
3.4 Model Criticism
Model criticism requires tests for convergence and testing goodness of fit on held out data. Since the primary objective of the study is to obtain the estimated parameter values, we also inspect the credible interval of the parameters. If the region is too wide we infer that the uncertainty in estimation is high.
Convergence Diagnostics: We select the Gelman-Rubin diagnostic [11], which checks for the lack of convergence by comparing the variance between multiple chains to the variance within each chain. Convergence is more straightforward to analyze for Variational Inference. The convergence criterion is simply to iterate until the ELBO no longer increases.
Goodness of fit is tested using posterior predictive checks, which are performed by simulating replicated data under the fitted model and then comparing these to the observed data to look for systematic discrepancies between real and simulated data [12].
Credible Interval: The motivation behind using a Bayesian approach is to find the range of possible values for the building parameters. A standard measure of confidence in some (scalar) quantity is the “width” of its posterior distribution. This can be measured using a 100(1 - , where we select as 0.05 to estimate parameters with a 95% probability,
where the interval for a parameter is bounded by (l,u) with a probability 1 . The credible interval is a Bayesian alternative to a frequentist confidence interval. A frequentist keeps the parameters fixed and varies the confidence interval whereas a Bayesian approach is to keep the credible region fixed and vary the model parameters.
3.5 Application of the Models
3.5.1 Exploration. In terms of building modeling, we are primarily interested in learning the different R and C parameters. As we consider different multi-state lumped models, the cardinality of the sets R and C may vary but the overall values should remain the same. To find the composite resistance of the equivalent circuit, the resistance and capacitance are obtained by Kirchoff’s law. However, the simple addition or geometric sum required to compute the composite parameters cannot straightforwardly be done as Bayesian Inference provides random variables rather than scalar quantities. The distribution of the sum of two random variables can be obtained by the convolution of their density functions.
3.5.2 Forecasting. We perform 24 hour ahead forecast, after learning the parameters of the model. We assume that a outdoor temperature forecast data is given to us and we assumed that the HVAC is operational in the last known mode. The forecasting and prediction of HVAC time is given in Algorithm 1. When the HVAC is set to a particular temperature and assuming that it is not changed within the horizon of the forecast, then the indoor temperature will be centered around the set-point in a range known as the thermostat hysteresis setting. In general, the range is lies within 0.5 – 1 We sample from the estimated parameters’ distributions to obtain the forecasting interval.
3.6 Implementation
We implemented the Bayesian State Space model using the PyMC3 probabilistic programming library in Python [36]. PyMC3 is built on Theano [40] and has built-in implementations for MCMC algorithms and Variational Inference methods. We formulated the different components of the state space model and set the prior distributions for the model parameters. We deployed our methods on a system with 16 GB RAM system and I7 processor. The initial version of the codes is available in the BSSP Github repository.
In this section we provide two case studies. In the first test case we compare the results with small dataset to contrast and compare the gray-box models’ solutions with the Kalman filter and Bayesian state space model. In the second case study, we present results and analyses on larger scale data from the Dataport Dataset [1].
4.1 Case Study I: Exploratory Study on a Benchmark Dataset
4.1.1 Dataset. We compare the results with the benchmark dataset provided in [3] and the circuit assumptions of the house mentioned in the paper. The data is from a Flexhouse in Risø DTU in Denmark, and was collected during a series of experiments carried out in February to April 2009, where measurements consist of five minute values over a period of six days. The dataset consist of a single signal representing the indoor temperature (C). Observed ambient air temperature at the climate station (C). Total heat input from the electrical heaters in the building (kW). The global irradiance was measured at the climate station (kW/).
4.1.2 Problem Formulation. First we constructed all the models suggested in [3]. The CTSM [25] package can be used to model Continuous Time Stochastic Processes which is realized using an Extended Kalman Filter (EKF). We define R, C, and A to be the set of resistances, capacitances and area of solar infiltration for individual models. The three models which we chose for inspection and their system dynamics as follows:
• Ti Model: Here the house as a whole is assumed to have one thermal resistance () and capacitance ().
• TiTe Model: We provided a detailed description of formulation using the TiTe model in Section 3.2.
• TiTeTh Model: The three state model represents the interior subscripted by i, the exterior subscripted by e and the heater subscripted by h. The formulation for the three states are as follows:
4.1.3 Results Discussion. We show the results of the first case study in Table 1. We provide the estimated model parameters – R, C and Aw, within a 95% credible interval range as shown in Table 1. The total R and total C the composite thermal resistance and capacitance of the building. We compare the results of Bayesian Inference with the point estimates with an Extended Kalman Filter (EKF). The insights from the study are as follows:
Estimated model parameters: From the Table 1 we found that the mean of the credible interval for the estimated parameters for the Bayesian approaches is similar to that of the EKF point estimate. The EKF assumes the parameters to have uniform priors and thus performs MLE for estimation. An approximate ADVI provides a similar parameter estimation as that of an equivalent run of MCMC inference.
Comparison with the point estimates: A direct comparison of the model’s performances between the Bayesian methods and the EKF is difficult. We take the mean of the parameter estimated from Bayesian inference and then perform a one-step-ahead prediction and compare that with the EKF. The metrics used for comparison are the root mean squared (RMSE) and the normalized root mean squared errors (NRMSE) of the one-step-ahead prediction and we find that estimates from ADVI give us the best results (Table 1).
Time of execution to reach convergence: MLE estimates of the EKF is the fastest as it does not require computation of the full posterior distribution, however, it does not provide estimation error over model parameters. The MCMC algorithm is the most time consuming one, where we increase the number of steps and check for convergence using Gelman-Rubin diagnostic. We selected
Table 1: Results of Study I
4 chains and an initial burn in 5000 steps which is intended to give the Markov Chain time to reach its equilibrium distribution when there is a random initial starting point. Compared to MCMC, ADVI is much faster. For the TiTeTh model, we obtain no convergence for the EKF or MCMC, i.e. the credible intervals are very wide. But ADVI provides reasonable intervals for some parameters. We listed the time of execution for the different approaches in Table 1.
Monte-Carlo simulation: We perform a Monte-Carlo simulation to generate the possible indoor temperature scenarios when weather and HVAC usage is provided. In Figure 5 we show the results of the simulated prediction for the Ti and TiTe models, drawing samples from the inferred parameter distributions. We considered the starting state to be drawn from a N(70, 5) distribution, i.e. our guess for the indoor temperature will be within the range of 60 -80F. The simulated prediction shows that the actual value of the indoor temperature is enclosed within the credible region. It, however, deviates in certain sections, which we hypothesize is because the thermal mass of a house can change with varying temperature. The RC constant [8] of the data changes with time as the thermal mass C of a house can vary, due expansion (or contraction) of air. A more generalized formulation of thermal dynamics will require exploring longitudinal studies that to correlate between the parameter and temperature changes with the heater and cooler usage for long duration.
Qualitative assessment of the hidden states: In Figure 6, we show the learned hidden states of the two-state TiTe and three state TiTeTh model. For the TiTe model shown in Fig 6a, show that the estimated hidden state for the envelope is sandwiched between the indoor temperature and the outdoor temperature and is more correlated with the indoor temperature. Whereas in the TiTeTh model (Fig 6b) the envelope state is more correlated with the outdoor temperature. However, the heater’s temperature is the same as that of the indoor temperature, which implies it does not
Figure 5: Monte Carlo Simulation of Indoor Temperature
capture an independent factor of the hidden state space. The plots
Figure 6: Visualizing Hidden State Dynamics
in Fig 6 show the error margin of the hidden states obtained from the highest posterior distribution.
Forecasting: We compared the forecasting results of the BSSM with an auto-regressive integrated moving average with exogenous variables (ARIMAX). We used the first 5 days for training the BSSM and learn the building parameters. We then used the learned parameters to obtain a day ahead forecast within 95% prediction interval, as presented in Algorithm 1. Our assumption is that the heater stays in the same state as the last known state and assumed that the solar radiation and temperature data are available. In Figures 7a – 7c we show the output of forecasting for the ARIMAX, Ti and TiTe models. For quantitative evaluation we chose the mean absolute percentage error (MAPE) to find the error in mean of the forecast and calculated the percent of data within 95% forecast interval as shown in Table 2. The mean forecast error is lower in case of the BSSM models as they better learn the dynamics of the process. However, as the model parameters have a narrow credible interval, the actual data lies outside the forecast interval in but provides a narrower band for which the actual value partially lies outside the credible interval. In contrast, the forecasting result of ARIMAX has less correlation, although the actual forecast is within the confidence interval.
Table 2: Results of Forecasting
4.2 Case Study II: Prior Selection & Transfer Learning
4.2.1 Dataset. The Dataport dataset is a publicly available dataset, created by Pecan Street Inc, which contains building-level electricity data from 1000+ households. We performed our experiments on three single-family homes from Texas (dataid = 484, 739, 1507) based on metadata availability and proper registration of indoor temperature and HVAC usage data. The metadata, which has information about 52 homes, provides a general understanding about the buildings and helps us create prior distributions over the Rvalues. Here, House 739 does not have heating data available and the metadata does not include a measure for House 1507’s R-value.
4.2.2 Experimental setup. In this case study we explore the effects of prior selection and transfer learning. The two processes are inherently tied together, since in the Bayesian approach, “today’s posterior becomes tomorrow’s prior.” Our approach here is to learn the parameters from the AC usage season, where data is more consistent, and transfer the learned parameters as priors to seasons when HVAC has typically no usage and/or operates in heating mode. We investigate the effect of three sets of priors:
• Informed Priors (Set 1): We selected informed gamma priors. This is useful when we have some notion about the parameters’ values such as an initial audit to estimate the R-value of a building. We select a strong prior on the R-value where the mean of the R-value is same as that of the estimate and the standard deviation is 1.
• Hyper Priors (Set 2): In this set, we don’t have a direct estimation regarding the buildings’ parameters but have a vague understanding about the expected value from the metadata. We encode such beliefs by setting a hyper-prior for the mean, that is sampled selected from a mixture of lognormal distributions. We empirically found that R-values are a mixture of lognormal distributions, conditioned on the year built and conditioned square foot, by performing a maximum likelihood estimate. The estimated parameters of the two lognormal distributions as shown in Fig 1, are (0.59) and () = (3.43, 0.50), respectively.
• Uninformed Priors (Set 3): Finally, in Set 3, we chose uninformed flat gamma priors for the R-values, where, we have no knowledge of the buildings’ parameters. In all three cases we set a flat gamma prior on the C-values. For all three cases, we set an upper bound on the R-values to be 70, which we found from the metadata. We assign an uninformed gamma prior on the C values. For all cases, we initially estimate for the AC usage scenario and use the mean and variance of the estimated parameters to set the prior for the other seasons. The sign of the heat flux, as provided in Eqn 8, is negative when AC is used
Figure 7: Comparison of Forecasting
Table 3: Results of Case Study II
and the HVAC is in cooling mode. We do not have an exact value for heater’s flux but we use the furnace which provides the binary “ONOFF” signal of the heater and multiply an extra unknown parameter to estimate the heat flux. Similarly to the previous section, we estimate all parameters within a 95% credible interval. We also varied the size of the dataset of sizes [200, 500, 1000, 2000, 5000].
4.2.3 Results. The prior selection directly influences the value of the parameters, parameter transfer and depends on the size of the dataset. A summary of the results is presented in Table 3 for 2000 data points, which provides us the most likely parameter estimates. We present the result in the form of mean and the error margins i.e. (). We find that the Informed Priors provide us with the most consistent estimates both across size of the datasets and when we perform transfer learning. As shown in Fig 8, the informed parameters remain consistent with the change in the size of the dataset with very little margin of error (1). Parameter transfer also works best when informed priors are applied (Fig 8), but can provide us different estimates when being transferred from AC usage to Heater usage seasons. The hyper-priors reduce the margin of error when applied for smaller datasets. For example, in Fig 10, the R-values have large error margins when uninformed priors are chosen, which is significantly reduced when hyperpriors were used Fig 9.
4.2.4 Discussion. Information in the data overwhelms prior information not only when the size of the dataset is large, but also when the prior encodes relatively small information. For example in House 739 (Table 3), an approach using uninformed priors will
try to get the best estimate that fits the data, but the parameters may not be accurate. For this case, a sharp prior centered around an initial estimate gives the best result. Uninformative priors are easily persuaded by data, while strongly informative ones may be more resistant. When the size of the dataset is small, hyperpriors effectively reduce the margin of error in parameter estimation Fig. 9.
4.3 General Recommendations
Based on our studies, we recommend constructing a Bayesian state space model customized for the problem at hand, carefully selecting the system dynamics and priors. We suggest using ADVI for parameter estimation as it provides similar estimates but is faster than MCMC. In realistic settings, it is better to perform an initial audit to determine the home’s insulation parameters and fix an informed prior on the parameter set. We suggest to use informative priors, if enough metadata is available to set them reliably. However, if the objective is to monitor a large set of homes, we recommend setting a hyper prior based on the beliefs from a sample of the dataset. If the heat flux is known from the HVAC, learning from one season and applying it to another can improve estimation.
In this paper, we proposed and systematically studied Bayesian statistical approaches to buildings’ thermal parameter estimation. We developed a generalized state-space modeling framework that integrates building physics equations with a statistical model. The model estimates buildings’ structural parameters which influence the indoor temperature conditioned on HVAC usage and weather
Figure 8: Informed Prior set on R-values
Figure 9: Hyper Prior set on R-values
Figure 10: Uninformed set on R-values
These figures show the results of parameter estimation of R and C values for House 484 with varying data sizes and different prior selection.
factors. We contrast model learning using MCMC and ADVI algorithms and show that Variational Inference is faster and provides a similar estimation to MCMC. A visual inspection of the hidden states was employed to assess the model dynamics, and we found that merely increasing model complexity does not capture any significant factors of the thermal characteristics. We further showed the model’s applications, such as simulating probable outcomes and forecasting the future. The effects of prior selection on the parameter estimation were studied in detail. We found that informed priors provide the best estimates, but when such information is not present prior beliefs can help to better learn the models. Also, we found that priors are key to transfer learning, and model parameters learned from one season can be used to model thermal dynamics under the condition that properly scaled exogenous data is available.
The focus of our future research is in two directions. We are presently instrumenting several homes with smart thermostats and temperature sensors. This study serves as a guide to large-scale analysis as we attempt to further incorporate air leakages and construct room level thermal behavior analysis. We plan to learn from the data that is being collected longitudinally and incorporate the learned models in NEST thermostats to monitor homes’ condition continuously. Secondly, we will focus on incorporating air-leakage into the framework and correlating with standardized metrics such as . Common air-infiltration models (e.g. LBL model [37]), have complex non-linear characteristics for which we will explore non-linear state space models.
[1] [n. d.]. Source: Pecan Street Inc. Dataport 2018. ([n. d.]).
[2] 2017. Annual energy outlook 2017. US Energy Information Administration (2017).
[3] Peder Bacher and Henrik Madsen. 2011. Identifying suitable models for the heat dynamics of buildings. Energy and Buildings 43, 7 (2011), 1511–1522.
[4] Matthew James Beal et al. 2003. Variational algorithms for approximate Bayesian inference. University of London London.
[5] Yoshua Bengio and Paolo Frasconi. 1995. An input output HMM architecture. In Advances in neural information processing systems. 427–434.
[6] David M Blei. 2014. Build, compute, critique, repeat: Data analysis with latent variable models. Annual Review of Statistics and Its Application 1 (2014), 203–232.
[7] David M Blei, Alp Kucukelbir, and Jon D McAuliffe. 2017. Variational inference: A review for statisticians. J. Amer. Statist. Assoc. 112, 518 (2017), 859–877.
[8] Robert L Boylestad, Louis Nashelsky, and Lihua Li. 2002. Electronic devices and circuit theory. Vol. 11. Prentice Hall Englewood Cliffs, NJ.
[9] Adrian Chong, Khee Poh Lam, Matteo Pozzi, and Junjing Yang. 2017. Bayesian calibration of building energy models with large datasets. Energy and Buildings 154 (2017), 343–355.
[10] Enrico Fabrizio and Valentina Monetti. 2015. Methodologies and advancements in the calibration of building energy models. Energies 8, 4 (2015), 2548–2574.
[11] Andrew Gelman, Kenneth Shirley, et al. 2011. Inference from simulations and monitoring convergence. Handbook of markov chain monte carlo (2011), 163–174.
[12] Andrew Gelman, Hal S Stern, John B Carlin, David B Dunson, Aki Vehtari, and Donald B Rubin. 2013. Bayesian data analysis. Chapman and Hall/CRC.
[13] John Geweke and Hisashi Tanizaki. 2001. Bayesian estimation of state-space models using the Metropolis–Hastings algorithm within Gibbs sampling. Computational Statistics & Data Analysis 37, 2 (2001), 151–170.
[14] Siddhartha Ghosh, Steve Reece, Alex Rogers, Stephen Roberts, Areej Malibari, and Nicholas R Jennings. 2015. Modeling the thermal dynamics of buildings: A latent-force-model-based approach. ACM Transactions on Intelligent Systems and Technology (TIST) 6, 1 (2015), 7.
[15] Neil J Gordon, David J Salmond, and Adrian FM Smith. 1993. Novel approach to nonlinear/non-Gaussian Bayesian state estimation. In IEEE Proceedings of Radar and Signal Processing, Vol. 140. IET, 107–113.
[16] MM Gouda, Sean Danaher, and CP Underwood. 2002. Building thermal model reduction using nonlinear constrained optimization. Building and environment 37, 12 (2002), 1255–1265.
[17] Yeonsook Heo, Ruchi Choudhary, and GA Augenbroe. 2012. Calibration of building energy models for retrofit analysis under uncertainty. Energy and
Buildings 47 (2012), 550–560.
[18] Matthew D Hoffman and Andrew Gelman. 2014. The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research 15, 1 (2014), 1593–1623.
[19] Tianzhen Hong, S.K Chou, and T.Y Bong. 2000. Building simulation: an overview of developments and information sources. Building and Environment 35, 4 (2000), 347 – 361.
[20] Rune Juhl, Niels Rode Kristensen, Peder Bacher, Jan Kloppenborg, and Henrik Madsen. 2017. Grey-box modeling of the heat dynamics of a building with CTSM-R. (2017).
[21] Young-Jin Kim, Seong-Hwan Yoon, and Cheol-Soo Park. 2013. Stochastic comparison between simplified energy calculation and dynamic simulation. Energy and Buildings 64 (2013), 332–342.
[22] Kevin J. Kircher and K. Max Zhang. 2015. On the lumped capacitance approximation accuracy in RC network building models. Energy and Buildings 108 (2015), 454 – 462.
[23] Wilhelm Kleiminger, Friedemann Mattern, and Silvia Santini. 2014. Predicting household occupancy for smart heating control: A comparative performance analysis of state-of-the-art approaches. Energy and Buildings 85 (2014), 493 – 505. https://doi.org/10.1016/j.enbuild.2014.09.046
[24] Martin Heine Kristensen, Ruchi Choudhary, and Steffen Petersen. 2017. Bayesian calibration of building energy models: Comparison of predictive accuracy using metered utility data of different temporal resolution. Energy Procedia 122 (2017), 277–282.
[25] Niels Rode Kristensen and Henrik Madsen. 2003. Continuous time stochastic modelling. Mathematics Guide (2003), 1–32.
[26] Niels Rode Kristensen, Henrik Madsen, and Sten Bay JÃÿrgensen. 2004. Parameter estimation in stochastic grey-box models. Automatica 40, 2 (2004), 225 – 237.
[27] Alp Kucukelbir, Dustin Tran, Rajesh Ranganath, Andrew Gelman, and David M Blei. 2017. Automatic differentiation variational inference. The Journal of Machine Learning Research 18, 1 (2017), 430–474.
[28] Amine Lazrak and Michael Zeifman. 2017. Estimation of Physical Buildings Parameters Using Interval Thermostat Data. In Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments (BuildSys . ACM, New York, NY, USA, Article 22, 4 pages.
[29] Qi Li, Godfried Augenbroe, and Jason Brown. 2016. Assessment of linear emulators in lightweight Bayesian calibration of dynamic building energy models for parameter estimation and performance prediction. Energy and Buildings 124 (2016), 194 – 202.
[30] Jaakko Luttinen. 2013. Fast variational Bayesian linear state-space model. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 305–320.
[31] Dougal Maclaurin. 2016. Modeling, inference and optimization with composable differentiable procedures. Ph.D. Dissertation.
[32] Radford M Neal et al. 2011. MCMC using Hamiltonian dynamics. Handbook of Markov Chain Monte Carlo 2, 11 (2011).
[33] Henrik Aalborg Nielsen, Stig Bousgaard Mortensen, Peder Bacher, and Henrik Madsen. [n. d.]. Analysis of energy consumption in single family houses.
[34] T. Agami Reddy, Itzhak Maor, and Chanin Panjapornpon. 2007. Calibrating Detailed Building Energy Simulation Programs with Measured Data–Part I: General Methodology (RP-1051). HVAC&Research 13, 2 (2007), 221–241.
[35] Simon Rouchier, Mickaël Rabouille, and Pierre Oberlé. 2018. Calibration of simplified building energy models for parameter estimation and forecasting: Stochastic versus deterministic modelling. Building and Environment 134 (2018), 181–190.
[36] John Salvatier, Thomas V Wiecki, and Christopher Fonnesbeck. 2016. Probabilistic programming in Python using PyMC3. PeerJ Computer Science 2 (2016), e55.
[37] Max H Sherman. 1992. Superposition in infiltration modeling. Indoor Air 2, 2 (1992), 101–114.
[38] Michael Siemann. 2013. Performance and applications of residential building energy grey-box models. University of Maryland, College Park.
[39] Albert Tarantola. 2005. Inverse problem theory and methods for model parameter estimation. Vol. 89. siam.
[40] Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs/1605.02688 (May 2016). http://arxiv.org/abs/1605.02688
[41] Ilker Yildirim. 2012. Bayesian inference: Gibbs sampling. Technical Note, University of Rochester (2012).