RESEARCH COMMONS
LIBRARY

Automating Inhabitant Interactions In Home And Workplace Environments Through Data-driven Generation Of Hierarchical Partially-observable Markov Decision Processes

ResearchCommons/Manakin Repository

Automating Inhabitant Interactions In Home And Workplace Environments Through Data-driven Generation Of Hierarchical Partially-observable Markov Decision Processes

Show simple item record

dc.contributor.author Youngblood, Gregory Michael en_US
dc.date.accessioned 2007-08-23T01:55:56Z
dc.date.available 2007-08-23T01:55:56Z
dc.date.issued 2007-08-23T01:55:56Z
dc.date.submitted July 2005 en_US
dc.identifier.other DISS-1011 en_US
dc.identifier.uri http://hdl.handle.net/10106/31
dc.description.abstract Markov models provide a useful representation of system behavioral actions and state observations, but they do not scale well. Utilizing a hierarchy and abstraction through hierarchical hidden Markov models (HHMMs) improves scalability, but these structures are usually constructed manually using knowledge engineering techniques. We introduce a new method of automatically constructing HHMMs using the output of a sequential data-mining algorithm, Episode Discovery, and apply it to solving automation problems in the intelligent environment domain. Repetitive behavioral actions in sensor rich environments such as smart homes can be observed and categorized into periodic and frequent episodes through data-mining techniques utilizing the minimum description length principle. Utilizing this approach, we provide an architecture and a set of algorithms for a pervasive computing system showing that inhabitant interactions in home and workplace environments can be accurately automated through sensor observation and intelligent control using a data-driven approach to automatically generate hierarchical inhabitant interaction models in the form of HPOMDPs and these models may be modified using temporal-difference reinforcement learning techniques to continually adapt to changes in the inhabitant's patterns until a new model should be generated. We present our life-long learning system and apply this work in our MavPad and MavLab environments where we have been successful at automating up to 40% of the life of a real inhabitant and 76% of a virtual inhabitant as well as dynamically adapting to concept changes over time. Findings from several case studies are provided to show the feasibility of this approach. en_US
dc.description.sponsorship Holder, Lawrence B. en_US
dc.language.iso EN en_US
dc.publisher Computer Science & Engineering en_US
dc.title Automating Inhabitant Interactions In Home And Workplace Environments Through Data-driven Generation Of Hierarchical Partially-observable Markov Decision Processes en_US
dc.type Ph.D. en_US
dc.contributor.committeeChair Holder, Lawrence B. en_US
dc.degree.department Computer Science & Engineering en_US
dc.degree.discipline Computer Science & Engineering en_US
dc.degree.grantor University of Texas at Arlington en_US
dc.degree.level doctoral en_US
dc.degree.name Ph.D. en_US

Files in this item

Files Size Format View
umi-uta-1011.pdf 37.93Mb PDF View/Open
37.93Mb PDF View/Open

This item appears in the following Collection(s)

Show simple item record

Browse

My Account

Statistics

About Us