Finding the creatures of habit; Clustering households based on their flexibility in using electricity
% You can go ahead and credit any number of authors here
% e.g. one 'row of three' or two rows (consisting of one row of three % and a second row of one
two or three). % % The command \alignauthor (no curly braces needed) should % precede each author name
affiliation/snail-mail address and % e-mail address. Additionally
tag each line of % affiliation/address with \affaddr
and tag the % e-mail address with \email. % % 1st. author \alignauthor Ian Dent
Uwe Aickelin and Tom Rodden\titlenote{Ian Dent is the corresponding author.}
%Ian Dent and Uwe Aickelin are affiliated with the Intelligent Modelling and Analysis %Research Group.
Changes in the UK electricity market, particularly with the roll out of smart meters, will provide greatly increased opportunities for initiatives intended to change households' electricity usage patterns for the benefit of the overall system. Users show differences in their regular behaviours and clustering households into similar groupings based on this variability provides for efficient targeting of initiatives. Those people who are stuck into a regular pattern of activity may be the least receptive to an initiative to change behaviour. A sample of 180 households from the UK are clustered into four groups as an initial test of the concept and useful, actionable groupings are found.
Digital_Futures_2012__Dent__-_Final.tex
% This is "sig-alternate.tex" V1.9 April 2009
% This file should be compiled with V2.4 of "sig-alternate.cls" April 2009
%
% This example file demonstrates the use of the 'sig-alternate.cls'
% V2.4 LaTeX2e document class file. It is for those submitting
% articles to ACM Conference Proceedings WHO DO NOT WISH TO
% STRICTLY ADHERE TO THE SIGS (PUBS-BOARD-ENDORSED) STYLE.
% The 'sig-alternate.cls' file will produce a similar-looking,
% albeit, 'tighter' paper resulting in, invariably, fewer pages.
%
% ----------------------------------------------------------------------------------------------------------------
% This .tex file (and associated .cls V2.4) produces:
%       1) The Permission Statement
%       2) The Conference (location) Info information
%       3) The Copyright Line with ACM data
%       4) NO page numbers
%
% as against the acm_proc_article-sp.cls file which
% DOES NOT produce 1) thru' 3) above.
%
% Using 'sig-alternate.cls' you have control, however, from within
% the source .tex file, over both the CopyrightYear
% (defaulted to 200X) and the ACM Copyright Data
% (defaulted to X-XXXXX-XX-X/XX/XX).
% e.g.
% \CopyrightYear{2007} will cause 2007 to appear in the copyright line.
% \crdata{0-12345-67-8/90/12} will cause 0-12345-67-8/90/12 to appear in the copyright line.
%
% ---------------------------------------------------------------------------------------------------------------
% This .tex source is an example which *does* use
% the .bib file (from which the .bbl file % is produced).
% REMEMBER HOWEVER: After having produced the .bbl file,
% and prior to final submission, you *NEED* to 'insert'
% your .bbl file into your source .tex file so as to provide
% ONE 'self-contained' source file.
%
% ================= IF YOU HAVE QUESTIONS =======================
% Questions regarding the SIGS styles, SIGS policies and
% procedures, Conferences etc. should be sent to
% Adrienne Griscti (griscti@acm.org)
%
% Technical questions _only_ to
% Gerald Murray (murray@hq.acm.org)
% ===============================================================
%
% For tracking purposes - this is V1.9 - April 2009

% \documentclass{sig-alternate} % to include copyright
\documentclass{acm_proc_article-sp} % to miss out copyright

\hyphenation{NESEMP pro-ject}
\hyphenpenalty=750
\hbadness=2200

\begin{document}
%
% --- Author Metadata here ---
\conferenceinfo{Digital Futures `12}{October 23 - 25, 2012, Aberdeen, UK}
\CopyrightYear{2012} % Allows default copyright year (20XX) to be over-ridden - IF NEED BE.
\crdata{}  % Allows default copyright data (0-89791-88-6/97/05) to be over-ridden - IF NEED BE.
% --- End of Author Metadata ---

\title{Finding the creatures of habit; Clustering households based on their flexibility in using electricity}
%\subtitle{[Extended Abstract]}

%
% You need the command \numberofauthors to handle the 'placement
% and alignment' of the authors beneath the title.
%
% For aesthetic reasons, we recommend 'three authors at a time'
% i.e. three 'name/affiliation blocks' be placed beneath the title.
%
% NOTE: You are NOT restricted in how many 'rows' of
% "name/affiliations" may appear. We just ask that you restrict
% the number of 'columns' to three.
%
% Because of the available 'opening page real-estate'
% we ask you to refrain from putting more than six authors
% (two rows with three columns) beneath the article title.
% More than six makes the first-page appear very cluttered indeed.
%
% Use the \alignauthor commands to handle the names
% and affiliations for an 'aesthetic maximum' of six authors.
% Add names, affiliations, addresses for
% the seventh etc. author(s) as the argument for the
% \additionalauthors command.
% These 'additional authors' will be output/set for you
% without further effort on your part as the last section in
% the body of your article BEFORE References or any Appendices.

\numberofauthors{2} %  in this sample file, there are a *total*
% of EIGHT authors. SIX appear on the 'first-page' (for formatting
% reasons) and the remaining two appear in the \additionalauthors section.
%
\author{
% You can go ahead and credit any number of authors here,
% e.g. one 'row of three' or two rows (consisting of one row of three
% and a second row of one, two or three).
%
% The command \alignauthor (no curly braces needed) should
% precede each author name, affiliation/snail-mail address and
% e-mail address. Additionally, tag each line of
% affiliation/address with \affaddr, and tag the
% e-mail address with \email.
%
% 1st. author
\alignauthor
Ian Dent, Uwe Aickelin and Tom Rodden\titlenote{Ian Dent is the corresponding author.}\\
%Ian Dent and Uwe Aickelin are affiliated with the Intelligent Modelling and Analysis %Research Group.\\
%Ian Dent and Tom Rodden are affiliated with the Horizon Digital Economy Research %Institute.}\\
       \affaddr{School of Computer Science}\\
       \affaddr{University of Nottingham}\\
       \affaddr{Nottingham, UK, NG8 1BB}\\
       \email{psxid@nottingham.ac.uk}      
\alignauthor
Tony Craig\\
       \affaddr{The James Hutton Institute}\\
       \affaddr{Craigiebuckler}\\
       \affaddr{Aberdeen, UK, AB15 8QH}\\
       \email{tony.craig@hutton.ac.uk}  
} 
% There's nothing stopping you putting the seventh, eighth, etc.
% author on the opening page (as the 'third row') but we ask,
% for aesthetic reasons that you place these 'additional authors'
% in the \additional authors block, viz.
\date{15th November 2011}
% Just remember to make sure that the TOTAL number of authors
% is the number that will appear on the first page PLUS the
% number that will appear in the \additionalauthors section.

\maketitle
\begin{abstract}
Changes in the UK electricity market, particularly with the roll out of smart meters, will provide greatly increased opportunities for initiatives intended to change households' electricity usage patterns for the benefit of the overall system. Users show differences in their regular behaviours and clustering households into similar groupings based on this variability provides for efficient targeting of initiatives. Those people who are stuck into a regular pattern of activity may be the least receptive to an initiative to change behaviour. A sample of 180 households from the UK are clustered into four groups as an initial test of the concept and useful, actionable groupings are found.
\end{abstract}

% A category with the (minimum) three required fields
%\category{H.4}{Information Systems Applications}{Miscellaneous}

%\terms{Algorithms, Economics, Human Factors}

\keywords{Electricity load profiles, Clustering, Flexibility, Demand Side Management} % NOT required for Proceedings

\section{Introduction}
The electricity market in the UK is undergoing dramatic changes. Legal, social and political drives for a more carbon efficient electricity network, along with the dramatically increased flow of data from households through the deployment of smart meters, is leading to a disruptive change in existing practices. In particular, the change of sampling of electricity usage from a 3 monthly billing cycle to a 30 minute (or shorter) sampling period using smart meters, alters the degree of understanding of households' behaviour that is possible \cite{Energy2009}.

One approach to addressing the pressures on the electricity network is the application of Demand Side Management (DSM) techniques to achieve changes in consumer behaviour at a domestic level \cite{river2005primer}. The Desimax project \cite{Kiprakis2011} (of which this work forms part) concentrates on applying DSM techniques to achieve better electricity system efficiency. The peak time for electricity usage in the UK is during the early evening and the successful application of techniques to reduce, or move, the peak usage would improve the efficiency of the electricity network. 

A marketing practice to efficiently address the most receptive customers is to partition the customers into a few (generally fewer than 10) stereotypical customers which can then be addressed individually. If it is decided that a particular stereotype would be receptive to a given approach, then the marketing campaign can target all the customers associated with the stereotype. This approach allows for cost effective targeting of the right subset of customers whilst allowing the company management to deal with a manageable number of stereotypes \cite{sarstedt2011concise}.

The growth in data provides interested parties, such as utility companies, with the ability to direct their behavioural change interventions in a more targeted way then previously. Clustering techniques provide a means of finding a few useful groupings of households where each grouping can then be targeted in an effective way particular to the characteristics of that grouping.

One behavioural trait that is useful to analyse is the flexibility that households exhibit in their daily behaviour. For instance, some households will be creatures of habit and will eat their evening meal at almost the same time each evening, whilst others have a much more variable lifestyle and will eat at varying times. Clustering households using their degree of flexibility provides a way of identifying the subset of electricity users who may be most receptive to an intervention intending to alter the timings of their activities.

A review of clustering of electricity load profiles has been published by Chicco \cite{chicco2012overview} and this shows that consideration of the flexibility features of households has not been considered previously.

\section{Methodology}
The ongoing North East Scotland energy monitoring project (NESEMP) is examining the relationship between different types of energy feedback and psycho-social measures including individual environmental attitudes, household characteristics, and everyday behaviours.  As part of this project, several hundred households were monitored and the electricity usage was recorded every five minutes using CurrentCost monitors over a period of a year \cite{Craig2012}. The volume of data input to the clustering exercise described in this abstract is of the order of 17 million individual readings.

After cleaning of households with insufficient readings, the data for 180 randomly selected households are loaded into a MySQL database and the readings are aligned with exact 5 minute boundaries (e.g. 1pm, 1.05pm, etc.) by interpolation between the actual readings. Each day of sampling is classified in a number of ways such as "working day" or "summer".

A subset of the data for the peak period of 4pm to 8pm and for working days throughout the year is extracted for further analysis. Average usage for each household within the evening period is calculated allowing for the ranking of all the households by the amount of electricity used per evening period.

One measure of flexibility is, for each day and for each household in the sample, to find the time at which the maximum usage of electricity occurred during the peak period of 4pm to 8pm. This time (calculated as minutes after 4pm) for each household can then be measured and the standard deviation of this time derived as the flexibility measure. A household showing regular behaviour for an example week is given at Figure \ref{fig:same}. This suggests the members of the household arrive home at a similar time on each weekday and immediately cook their evening meal. This happens about 6pm each day with Thursday being slightly later and Friday being earlier. In comparison, Figure \ref{fig:different} shows another household for the same week and shows irregular timings for the household's evening activities.

\begin{figure}[h!]
\centering
\includegraphics[width=2.5in]{same_time_cooking_55.png}
\caption{Maximum usage at similar times each day}
\label{fig:same}
\end{figure}

\begin{figure}[h!]
\centering
\includegraphics[width=2.5in]{different_cooking_times_227.png}
\caption{Maximum usage at irregular times}
\label{fig:different}
\end{figure}

The attributes of peak time usage and variability in time of maximum usage are used as input to a kmeans clustering exercise in order to identify four clusters. This clustering is run a number of times in order to allow for random starting conditions with the best overall solution taken.

\section{Results}

The clusters derived from the kmeans algorithm are shown at Figure \ref{fig:2attrs}.

\begin{figure}[h!]
\centering
\includegraphics[width=3.3in]{cluster_results_evening_clean_2d.png}
\caption{4 clusters found using 2 attributes}
\label{fig:2attrs}
\end{figure}

Interpretation of this simple graph shows that the households represented by green are those with higher evening usage of electricity and should be the ones targeted for general initiatives intended to reduce total electricity usage. 

Those households represented in red are the ones with the most variability in their day to day behaviour and may be the best to target with initiatives intended to change behaviour.

The households represented in black show little variability in behaviour and relatively low usage of electricity and it is likely they should be omitted from any initiatives.

Those households represented as blue are those with lower total usage and a middling degree of variability and would probably be addressed as a lower priority after the red and green households.

Using just 2 dimensions it is simple to plot the households by their dimensions and to draw a cut off line (e.g. 50 households to the top right of the diagram) in order to select a sub group for targeting. However, adding further attributes to represent aspects of the households' behaviour will greatly complicate the selection of a subset and the application of the clustering technique becomes more important. Adding an additional attribute representing the variability in the time of minimum usage during the evening peak period leads to the clusters shown on Figure \ref{fig:3attrs}. As can be seen from the Figure, selecting a subset visually becomes more challenging and adding further attributes will increase the complexity and, thus, the clustering approach becomes more useful.

\begin{figure}[h!]
\centering
\includegraphics[width=3.3in]{cluster_results_evening_clean.png}
\caption{4 clusters found using 3 attributes}
\label{fig:3attrs}
\end{figure}

\section{Conclusions}

This initial work shows that useful clusters using the concept of flexibility can be derived and can be used in cost effectively targeting appropriate behavioural change interventions at those households most likely to respond. For example, the households showing high variability in their behaviour could be targeted with a variable pricing initiative to encourage usage of cheaper electricity at off-peak times. These households are unlikely to see this as too much disruption from their normal, very variable, behaviour pattern and are likely to react positively to the initiative. In contrast, those households showing stable habitual behaviour would probably find any overt initiative to be too disruptive to their lifestyle and can be addressed using technological solutions, such as in-house batteries, which would allow shifting of their demand on the electricity network without disruption to their daily behaviour.

Future work will expand on the concept of flexibility to explore the identification of repeating activities (e.g. retiring to bed) by making use of the pattern of electricity usage and then exploring how those activities vary daily. Motifs representing regular activities, such as cooking, will be identified within a household's meter data and the variation of the timing of the motif between days will provide a basis for clustering the households. Figure \ref{fig:motifs} shows an example week of peak time usage for a household and highlights the possible motifs.

\begin{figure}[h!]
\centering
\includegraphics[width=2.5in]{motifs_1.png}
\caption{Possible motifs}
\label{fig:motifs}
\end{figure}

The groupings of households created using only the meter data will be compared with the groupings determined within the NESEMP project using the demographic and attitudinal data in order to provide validation of the effectiveness of the clustering technique described.

There is an increasing interest in the effectiveness of different forms of energy feedback on household energy behaviours. It would be interesting to explore the extent to which energy-flexibility could be fed back to households in an easy-to-understand manner.

%ACKNOWLEDGMENTS are optional
\section{Acknowledgements}

This work was possible thanks to EPSRC grant references EP/I000496/1 and EP/G065802/1.

%
% The following two commands are all you need in the
% initial runs of your .tex file to
% produce the bibliography for the citations in your paper.
\bibliographystyle{abbrv}
\bibliography{References}
    % sigproc.bib is the name of the Bibliography in this case
% You must have a proper ".bib" file
%  and remember to run:
% latex bibtex latex latex
% to resolve all references
%
% ACM needs 'a single self-contained file'!
%
%APPENDICES are optional
\balancecolumns

% That's all folks!
\end{document}

Digital_Futures_2012__Dent__-_Final.bbl
\begin{thebibliography}{1}

\bibitem{chicco2012overview}
G.~Chicco.
\newblock {O}verview and performance assessment of the clustering methods for
  electrical load pattern grouping.
\newblock {\em Energy}, Volume 42, Issue 1:68–80, June 2012.

\bibitem{Craig2012}
T.~Craig, C.~Galan-Diaz, S.~Heslop, and J.~Polhill.
\newblock {T}he {N}orth {E}ast {S}cotland {E}nergy {M}onitoring {P}roject
  ({NESEMP}).
\newblock In {\em {W}orkshop on {C}limate {C}hange and {C}arbon {M}anagement}.
  The James Hutton Institute, March 2012.

\bibitem{Energy2009}
DECC.
\newblock {Towards a Smarter Future, Government Response to the Consultation on
  Electricity and Gas Smart Metering}.
\newblock 2009.

\bibitem{Kiprakis2011}
A.~Kiprakis, I.~Dent, S.~Djokic, and S.~McLaughlin.
\newblock {M}ulti-scale {D}ynamic {M}odeling to {M}aximize {D}emand {S}ide
  {M}anagement.
\newblock In {\em IEEE Power and Energy Society Innovative Smart Grid
  Technologies Europe 2011, Manchester, UK}, 2011.

\bibitem{river2005primer}
River.
\newblock {P}rimer on demand-side management with an emphasis on
  price-responsive programs.
\newblock {\em prepared for The World Bank by Charles River Associates, Tech.
  Rep}, 2005.

\bibitem{sarstedt2011concise}
M.~Sarstedt and E.~Mooi.
\newblock {\em {A} concise guide to market research: {T}he process, data, and
  methods using {IBM} {SPSS} statistics}.
\newblock Springer Verlag, 2011.

\end{thebibliography}
