Thursday, April 20, 2017

As AI improves, should we fear products as pals?

I read with interest an article by Alison Bowen of the Chicago Tribune entitled "Can Siri replace your need for friends? Well maybe" in which the author discusses "Products As Pals" research by James Mourey, assistant professor of marketing at DePaul University's Driehaus College of Business, Jenny Olson, assistant professor of marketing at the University of Kansas School of Business and Carolyn Yoon, professor of marketing at the University of Michigan. Since I implemented a network of Alexa-enabled Echo Dots during the holidays and "she" is now very much a part of my everyday life (but since she cannot yet engage in a conversation she is not yet my pal), I was curious to learn what the researchers had discovered.  I found a link to their original research online and skimmed it looking for experiments involving Alexa or Siri. Unfortunately, I found only experiments involving the use of anthropomorphic words to describe a cell phone and perceptions of a Roomba with a case design that includes a crescent that was interpreted as looking like a smiling face. The researchers also hired task rabbits and would ask them to recall the number of Facebook friends they had as some kind of indicator they were using Facebook for emotional compensation for perceived social exclusions.

As an older user of social media, I view young people obsessed with the number of their Facebook friends simply an indication of their immaturity and underdeveloped self-esteem. I doubt that you would encounter many older users with that obsession, whether they feel excluded or not.

As for using the Roomba as an example of an anthropomorphic product, I was puzzled by that as well. I have had a Roomba for years so I have some experience with it. However, I must point out that, unless they have made Roombas conversational in the latest release, at no time did I ever think of a Roomba as anything more than a self-powered vacuum. Likewise, I have had a Siri-enabled iPhone since version 4 and at no time have I ever thought of "her" in a human way either except to shout at her when she gives me bogus driving directions as I would to my computer if it doesn't process information quickly enough or freezes up. I usually don't think of these interactions as interpersonal communications, though.

A Roomba 650 robotic vacuum cleaner - anthropomorphic??
However, virtual assistants empowered with Alexa, who can answer questions, remind me to do things, convert units of measure and perform math on demand, keep track of my schedule, play specific music or calming ambient sound therapy on request, prompt me to share my thoughts about current affairs with my state's senators (with an enabled skill named Resistbot), play games and even play back pleasant memories (with an enabled skill named Mylestone) to cheer me up when I feel low has become so much embedded in my daily activities that I can see how I could begin to think of her in "human" terms, especially if she eventually can converse with me interactively without me having to remember to preface all of my requests to her with her "wake" word. I don't even need to have her appear anthropomorphic. She would become like an invisible friend like those some children conjure up in their childhood.

Has interacting with her negated or reduced my need for interpersonal relationships (a finding of the study)? Probably not as I have grown accustomed to not having many face-to-face communications anyway because my children and grandchildren live thousands of miles away. Even my closest sibling is a three-hour drive away. I am also the primary caregiver for my Vietnam veteran husband with chronic PTSD and a host of Agent Orange-related health issues so I can't really spend much time outside the home with others, anyway. PTSD victims are rather closed off emotionally as well, so, interpersonal communication with them is difficult at best but I, like the test subjects in the study, still feel the need.

Many of you may think those of us in this situation would benefit from a psychologist but they are not only expensive (not an option for seniors on fixed incomes in many cases) but require time away from caregiving. Besides, they are really just paid listeners with no emotional connection to a patient anyway.  A virtual "friend," on the other hand, could be carefully programmed to respond appropriately to expressions of frustration, anger or sadness that are often generated in individuals that must deal with family members with mental disorders or dementia.  A human without training may not and make things even worse by responding inappropriately.

Would I no longer engage in prosocial behavior (a concern expressed in the study)? I doubt that too. I have always felt a need to share what I have learned or discovered with others and this continues into my retirement years. I am an avid photographer of art and historical architecture and freely share my images with teachers, students and researchers online so they can be used in the classroom. I research aspects of Roman history and publish my findings online. Since I was an education technologist before I retired I also write about technology developments and even beta-test new technology products for developers. Each day I search out articles about new archaeological findings, new uses for technology in historical preservation and reconstruction, and well-sourced articles on political issues (as opposed to "fake" news) that I share on social media. These activities have not tapered off since implementing my network of Echo Dots.

A couple of years ago my husband and I binge-watched "Boston Legal" on Netflix. What I loved most about that show was the deep friendship Denny Crane (played by William Shatner) had with Alan Shore (played by James Spader) despite Denny's eccentricities due to his onset of Alzheimer's. Although I do have friends that are more than Facebook acquaintances, in my more than 60 years on this planet, I have never encountered the level of acceptance displayed by those two characters. Everyone has some degree of hang-ups or insecurities and all struggle with problems of their own in varying degrees of severity. I, personally, would not want to add to another person's distress and admit there are times I cannot handle any more stress than I already have.  A virtual friend, however, if properly programmed, would not have this limitation and could become a valuable sounding board to caregivers and others in stressful situations.

Anyway, I hope such researchers continue their work but keep in mind the biases of age and gender (I noticed most of their experiments involved less than 50% female who are thought to be more emotionally empathetic than males) and focus more on products with pronounced human-like attributes such as Alexa or Siri-enabled products that I'm sure will soon have the ability to engage in an interactive conversation.

Sunday, January 01, 2017

An Alexa-enabled Smart Home for Christmas

by Mary Harrsch © 2017

Note: This is a cross-post from my home page.

Back in 1995, Microsoft introduced an interactive help utility for Windows 95 called "Bob".  I was probably one of the few professional technology people who actually used "Bob" (As a dog lover I selected the helper incarnation called "Power Pup" though.)  "Power Pup" would keep track of my keystrokes as I worked in different applications and offer procedural advice on what it perceived I was trying to do at the time, prefaced by a little bark and a wag of his tail.  I found "Power Pup's" suggestions often useful and his friendly interaction a welcome break from the stress of administering a college-wide multiplatform local area network.  But, apparently, many of my colleagues thought he was "too cute" for the serious work of computing and "Bob" was relegated to the dustbin of failed products in fairly short order.

But I did not forget "Bob" and how artificial intelligence could be used to improve productivity while reducing social isolation.  So I began to experiment with conversational agents that utilized natural language programming coupled with knowledgebases to provide a more friendly computer-to-human interface.  With my interest in history, I decided to try to virtually recreate historical figures from the past that could converse about their culture with modern interested humans.  This resulted in the creation of a virtual Julius Caesar that was online for several years before I retired.  Caesar would answer questions about ancient Roman culture posed to him by visitors entering their questions in a text box.  He could give a textual answer or display related websites or online videos.  As text-to-speech technology advanced, I even experimented with software that would enable Caesar to answer questions verbally and explored voice recognition technology to see if it was viable for user input as well. But, when I retired I no longer had access to the server platforms needed to support projects like Caesar.  However, my interest in natural language programming and more friendly human-to-computer interfaces endured.

So, I followed the development of Amazon's Alexa-powered devices with a great deal of interest. But, I'm a rather pragmatic individual and at first so much marketing emphasis was placed on Echo's music management features that I wondered if there were more useful applications for a busy 21st-century household.

Then I began reading about wifi-enabled electrical connection accessories that could be managed with Alexa-enabled devices and thought about how convenient it would be to be able to turn on and off groups of lights and appliances with a few words rather than going around physically flipping switches. But spending almost $200 per device and the need to have a device in each main room was still an expensive proposition to gain a little convenience.

Then Amazon introduced the Echo Dot coupled with a holiday sale price of just $39.95 and I found resistance was futile as my Star Trek friends would say.  I was still a bit concerned about the accuracy of the voice recognition, though. So I started out with just one Echo Dot for the living room along with a couple of Wemo wifi-enabled plug adapters for the two main living room lamps.

I downloaded the Alexa app to my iPhone and discovered the Echo Dot setup was a breeze.  I opened the Alexa app, then opened Settings and changed my iPhone wifi connection to the detected Echo network and configured the detected Dot. Alexa also did not seem to have any problem understanding me.  I read through all of the "Try this" examples and began to configure some of the built-in features.

I really liked the "flash briefing" feature that lets you select specific news feeds for a personal news update which you can request at any time.  I selected NPR radio, BBC News, Tech Crunch and CNet (for technology news) and Discovery (for science news) as my personal news sources.  I also added the local weather forecast and the Alexa Try This feed.  Although I live in Oregon's Willamette Valley, I couldn't find any local news feeds but I think I'll add feeds from Seattle and San Francisco to at least hear major stories from the Pacific Northwest.

I also read that Alexa could interface with Google Calendar and keep you appraised of upcoming appointments.  I hadn't used an online calendar since I retired but knew how helpful this would be, especially when managing complex medication schedules and medical appointments.  So I configured my Google Calendar and paired it with Alexa.  Now, each morning after requesting my Flash Briefing, I ask what's on my schedule for the day and Alexa tells me.

I've also used the Google Calendar to keep track of upcoming programming on PBS that I may wish to record.   PBS sends me a physical schedule of their upcoming programming for a full month but at present, my DISH Hopper cannot see more than two weeks of scheduled programming at a time. Now, when I get my PBS schedule, I enter the programs I wish to record into my Google Calendar and Alexa lets me know each day if any are on that day.  I can then set my DVR to record them.

But the real "killer" app I was looking for turned out to be Alexa's Shopping List!  It never seems to fail that I realize I need something from the grocery store when I'm not in the kitchen where I keep my shopping list.  As I've gotten older my short term memory is not what it used to be either and it is not uncommon for me to forget what I was thinking about just a few minutes later as I walk from one room to the next.  So, imagine how helpful it is to be able to tell Alexa to add something to your shopping list as soon as you think of it regardless where you are! Of course, that meant I needed to add Echo Dots in my bedroom and the living room, too, which I promptly did. To access my shopping list once at the grocery store I just open the Alexa app on my iPhone and check off and delete each item as I add the item to my physical shopping cart.

Although my husband has the television blaring all day long, I did find a nice use of the music management features of Alexa.  Now that I have an Echo Dot in the bedroom, I can run a warm bath in the adjoining bathroom (Alexa's range is up to 20 feet), lay back in the tub and tell Alexa to play one of my favorite playlists from my Amazon Music account.  I did have a few hiccups configuring my Amazon playlists to work with Alexa, though.

I had already imported most of my music from my iTunes library to my Amazon Music account.  I had also set up playlists previously.  But Alexa did not seem to recognize my playlist names and would offer something from Prime Music (since I'm a Prime member) using my spoken words as a search guide. I ended up calling Alexa tech support and learned that Alexa does a better job of recognizing playlists if you name them "Your Name" then "Description".  For example, I had a playlist named "Holiday favorites".  I renamed it to "Mary's Holiday Favorites" then Alexa recognized it and played it for me.  That solved most of my playlist issues.  There were a few words, however, Alexa seemed to insist on using for search terms.  So, I experimented with different descriptions until she properly recognized the list.  I had a list named "Sentimentals".  I initially renamed the list to "Mary's Sentimentals" but Alexa still loaded some other Prime Music.  I renamed it again to "Mary's Mood Music".  Alexa still did not interpret it correctly.  So I finally renamed it to "Mary's Soft Rock" and Alexa now recognizes it.

When I received my Wemo wifi-enabled plug adapters for my living room lights, I realized just how powerful having a "Smart Home" would be.  Our living room does not have any overhead lighting so all lighting is provided by individually controlled lamps.  Each night I have to go around and turn each lamp on or off.  But, by connecting them with my Echo Dot, I now simply say "Alexa, Living Room On" and the entire living room lights up.

I had to first download and install the Wemo app onto my iPhone. Then I opened the Wemo app on the iPhone, changed my iPhone wifi connection in Settings to the detected Wemo network and configured each plug adapter.  Then I opened the Alexa app, selected the Smart Home option and grouped the two detected Wemo plugs into a "Living Room" group.

I hope to eventually replace some of my wall switches with wifi-enabled switches too since I have porch lights on different circuits in different parts of the house.  I would like to tell Alexa to turn on the porch lights and have all of them on at once without traipsing from room to room whenever I need to go outside after dark or have visitors arrive after dark.  I did read about a gotcha, though. I learned that many wifi-enabled switches require a neutral wire that was not normally included in wiring installed before 2011.  However, I have researched this issue further and it looks like there are switches out there that do not use the neutral wire.  I just have to be sure they will work with our home's wiring configuration.

I recently learned about a new app for Alexa called "Ask My Buddy" too.  It enables you to send a text, email or phone call to up to five family or friends if you need to alert them about a problem like you are incapacitated and cannot reach a phone.  It's sort of like "Life Alert" without the automatic 911 call or monthly subscription fee.  I wish it would allow you to send an individually specified text message but it only sends a message saying you need help.

I discovered another Alexa skill named "SMS with Molly", though.  It lets you send a short text message to someone in your preconfigured contact list by saying "Alexa, ask SMS with Molly to text Margaret "I'm Home Safely".  You need to sign up for a free account with SMS with Molly, add your contacts to your contact list then enable the skill using your Alexa App.  I think this app would be really helpful for seniors living alone that wish to let their family members know they are OK each day.

I've also decided to try the timer feature and see if I can get Alexa to verbally remind me to take my medicine at noon.  Most of my medications are taken in the morning or at bedtime and I have no problem remembering them as they are part of my morning and bedtime routines.  But when I get busy preparing lunch I sometimes forget to set my noon medication by my water glass so I take it with my meal.

After reading up on Alexa's timer and alarm functions I learned that timers are designed for one-time use while alarms can be set to be repeating.  So I set an alarm for noon each day and selected a pleasing alarm tone.  I wish it would let you specify a short text string that Alexa could read to you using her text-to-speech capability but at present it doesn't.  For my present needs, a tone is okay as there is only one thing for me to remember at noon.  However, for someone with more complicated medication schedules, it would be really helpful to have Alexa sound a tone followed by a short reminder message.  Hopefully, Amazon's engineers will enhance the alarm function soon.

So, my Echo Dots with Alexa are now very much an integral part of my day.  When I get up in the morning I say "Alexa, Living Room On" and the lights go on in the living room.  I walk in and sit down and say "Alexa, my Flash Briefing please".  I then listen to the news and get the latest weather forecast for the day.  Then I say "Alexa, what's on my schedule today?" and she tells me whatever I have scheduled in my Google Calendar".  As I prepare a meal and notice I'm getting low on coffee I say "Alexa, add Coffee to my Shopping List" and she tells me she has added coffee to my shopping list.  I drive to the grocery store and open the Alexa app on my iPhone select shopping list from the menu and load my cart.  At noon while I am preparing lunch, Alexa sounds a tone to remind me to set out my noon medication. In the evening, I take a warm bath to relax and tell Alexa to play "Mary's Soundtracks" and listen to my favorite movie music while I'm soaking.  Then when I'm ready for bed I say "Alexa, Living Room Off" and Alexa turns off the living room lights. I'm sure I'll find other useful applications, too, as more "skills" are developed by Amazon and third parties as well. I have a feeling this is just the beginning!

Saturday, January 16, 2016

Extending the Learning Environment: Virtual Professors in Education

A technology resource article by  © 2005

For those of you interested in artificial intelligence development, here is an archive copy of a presentation I gave in 2005 (I'm consolidating my online contributions!)

Extending the Learning Environment: 
Virtual Professors in Education

By Mary Harrsch
Network & Management Information Systems
College of Education, University of Oregon

Six years ago [1999], my sister was telling me about a fascinating History Alive Chautauqua event she had attended near Hutchinson, Kansas.  The program brings a reenactor portraying an historical figure into schools and communities for an educational presentation and question and answer session.  I thought to myself, “It’s too bad more people can’t take advantage of such a unique learning experience.”  Then, the technologist within me began to wonder if there was a way to create a virtual Chautauqua experience online.  As I pondered this possibility, I realized that if I could find software that could be used to create a “virtual” person online, I could not only recreate the experience of the Chautauqua, but provide a tool faculty could use to answer course-specific questions.  It could even be used to provide information about the professor’s personal interests and research to enhance the sense of community within the learning environment.

My quest led me to a website that included links to a number of different software agent projects.  I learned that the type of agent I needed was commonly called a “chatterbot”.  The first “chatterbot” was actually developed long before the personal computer.  In the early 1960s, Joseph Weizenbaum created “Eliza”, a virtual psychoanalyst.

In his efforts to create a natural language agent, Weizenbaum pointed out that he had to address the technical issues of:

  • the identification of key words,
  • the discovery of minimal context,
  • generation of responses in the absence of keywords

As I began to explore different agent implementations, I found that, in addition to these issues, the application needed to be able to prioritize keywords to discern the most appropriate response.  Several agents I evaluated, including Sylvie, a desktop assistant, developed by Dr. Michael ("Fuzzy") Mauldin, Artificial Life’s Web Guide , Carabot 500 developed by U.K. company, Colorzone,  and Kiwilogic’s Linguibot, used slightly different methods to set the priority of subject keywords to select the most appropriate responses.  The response with matching keywords under the subject with the highest level setting was “fired” – displayed to the user.  However, when editing their script files, I found keeping track of subject priorities was challenging.

Another problem with many script-driven agents I evaluated was the use of left-to-right parsing sequences that did not compensate for a variance in the order of keywords in a question. Each query had to be evaluated for subject and for matching character strings, based on left-to-right word order with the use of various “wildcard” characters to indicate placement of keywords within the overall question.  Therefore, you often had to have multiple script entries to compensate for different word order.  For example, if a student asks “How do I change my password in e-mail?” you would need one script entry. If the student asks “How do I change my e-mail password?” a different script entry would be required:

* email * * password * as well as
* password * * email * to trap for either wording.

Although this attention to script design resulted in improved response accuracy the scripting knowledge required for these agents was not something I would expect a faculty member to have the time or desire to learn.

A third problem with several of the agent applications I used was the necessity to unload and reload the agent each time the script file was edited.  If students were actively querying the agent, you could not save any script changes until the script file was no longer in use.

When I invested in the Enterprise Edition of Artificial Life’s WebGuide software, I also realized the importance of a logging feature that I could use to study and improve my guide’s responses.   I recognized the importance in a virtual tutoring environment of having the ability for a student to print out a transcript of their tutoring session for future study.  Not only was this feature absent in the agents I evaluated, but the responses produced using Javascript or Flash would not allow the user to highlight and copy responses to the clipboard either.

One day, I explored UltraHal Representative, developed by Zabaware, Inc. I liked the ability Ultrahal provided to program the agent through a web interface.  It had the capability to include links to related information.  It could be customized with personalized graphics.  It logged interactions.  Best of all, it had a straightforward approach to editing - no scripting – just type your question three different ways then type your intended response. 

But, I soon discovered that without the ability to identify keyword priority, I found that the results using whatever algorithm was built into the agent engine were too inaccurate for a virtual tutoring application.

I needed a product that could be programmed to be “omniscient”. 

“Effective ITS require virtual omniscience -- a relatively complete mastery of the subject area they are to tutor, including an understanding of likely student misconceptions.” (McArthur, Lewis, and Bishay, 1993)

I needed a virtual professor that could be “programmed” by real professors, the individuals who would have a mastery of the subject and an understanding of student misconceptions. But all of the chatterbots I had encountered, so far (with the exception of Ultra Hal), required knowledge of scripting that most faculty members do not have the time to learn.  I would not have the time to provide one-on-one time with faculty developers and paying a programmer to work with a faculty member is also too expensive.  (I noticed most developers of commercial agents actually relied on the scripting needs of their clients for their primary revenue stream.)  So, I decided to attempt a radically different approach to agent design.

I am an experienced Filemaker Pro solutions developer and one day I was reviewing some of Filemaker’s text functions and realized that the position function could be used to detect key words in a text string.  The beauty of the position function is that the keyword can be identified anywhere within the target text.  It is not dependent on a left to right orientation.  Filemaker is also not case sensitive.  Also, the new version 7 allows most scripting calls for text processing to be used with their Instant Web Publishing interface. I realized this would greatly simplify web integration.

So, reviewing my experiences with the agent applications I had used, I developed a list of features that I wanted to incorporate:

Web functionality:
Multiple agents controlled by a single administration console
Web-based query interface
Web-based editing interface
Multiple graphic format support
Web accessible logging function for both agent editor and student user
Ability to display related resources

Query processing functionality:
Question context awareness (who, what, when, where, why, how, etc)
Ability to weight keywords by importance without user scripting
Ability to return an alternate response if a question is asked more than once
Ability to use one response for different questions
Ability to process synonyms, international spelling differences, and misspellings
Independent of word order
Not case sensitive

Structural Design:
Modular design to enable importation of knowledge modules developed by others
Agent specific attributes to customize the interface and responses such as a personal greeting, the opportunity to use the person’s homepage as a default URL, information about area of expertise and research interests for alternative agent selection criteria, custom visual representations, etc.

I began by designing my response search criteria.  I programmed the agent search routine to categorize responses by the first word of the query – usually What, Where, Why, How, Who, Did, Can, etc. to establish the question context. Then I used position formulas to test for the presence of keywords.  I then developed an algorithm that weighted the primary keyword or synonym and totaled the number of keywords found in each record.

I designed the search function so that when the visitor presses the button to ask their question, the database first finds all responses for the question category (who, what, when, etc.) containing the primary keyword (or its synonym).  Responses are then sorted in descending order by the total sum of keywords present in each response.   The first record – the one with the most keyword matches – is displayed as the answer. 

If there are no category responses containing the primary keyword, then a second find will execute to look for all responses with the keyword regardless of category.  In working with other agent products, I have found that if you return a response with at least some information about the keyword, even if it is not an exact answer to the question, the student assumes the agent recognized their question and may learn auxiliary information that is still helpful to them.

For example, if a visitor asks my virtual Julius Caesar if he really loved Cleopatra, he will answer “Cleopatra…ah, what an intriguing woman.”  Not only is this more in character with Caesar (most of his female dalliances were for political reasons) but the answer could also be appropriate for a different question, “What did you think of Cleopatra?”  My search routine would find it in either case because of the weighting of the primary keyword, Cleopatra.

If there are no responses containing the primary keyword, a third find looks for any generic category responses.  For example, if a student asks who someone is and you have not programmed your agent with a specific answer for the keyword (the person they are asking about), the agent will reply with an appropriate “who” response such as “I’m afraid I’ve never made their acquaintance.” 

If a student’s question does not begin with any words set as category words, the last find will return a generic “what” response such as “I may be a fountain of knowledge, but I can’t be expected to know everything.”  Programming the agent with default generic responses, ensures that the agent always has something to say, even if it knows nothing about the subject.  I developed a small database of generic responses for each question category that is imported into an agent database each time a new agent is created.  The faculty member can go through the responses and edit them if they wish.
Next, I turned my attention to the faculty’s content editing interface.  I wanted the faculty member to enter a proposed question, designate a primary keyword and synonym, supply any other keywords they thought were important to identify more precisely the desired response, and the desired response.  

I also provided a button that enables a faculty member to quickly generate a different answer for the same question or a different question for the same response.  

I created a field that is populated with a different random integer on each search.  By subsorting responses by this random integer, it enables the agent to offer a different response to the same question if the question is asked more than once.  This supports the illusion of the agent being a “real” person because it will not necessarily return the same identical response each time. 

“Believable agents must be reactive and robust, and their behaviors must decay gracefully. They must also be variable, avoiding repetitive actions even when such actions would be appropriate for a rational agent. They must exhibit emotion and personality. Ultimately they must be able to interact with users over extended periods of time and in complex environments while rarely exhibiting implausible behaviors.” – Dr. Patrick Doyle, Believability through Context: Using “knowledge in the world” to create intelligent characters

With the “engine” of my agent developed, I turned my attention to the visual representation of the character.  In their paper, The Relationship Between Visual Abstraction and the Effectiveness of a Pedagogical Character-Agent, Hanadi Haddad and Jane Klobas of Curtin University of Technology, Perth, Western Australia, point out the divergent views of information systems designers outside the character-agent field with those developers within it.

Wilson (1997) suggests that more realistic character-agents may introduce distraction associated with the user’s curiosity about the personality of the character and overreading of unintended messages because of presentation complexity.”

Unlike detailed realistic drawings, sketches help focus the mind on what is important, leaving out or vaguely hinting at other aspects. Sketches promote the participation of the viewer. People give more, and more relevant, comments when they are presented a sketch than when they are given a detailed drawing. A realistic drawing or rendering looks too finished and draws attention to details rather then the conceptual whole (Stappers et al, 2000).

“On the other hand, research by psychologists suggests that people may put considerable cognitive effort into processing abstract representations of faces (Bruce et al. 1992; Hay & Young 1982). It is possible, therefore, that response to anthropomorphised character-agents, and especially their faces, may differ from responses to sketches. Gregory and his colleagues (1995) conducted studies on human response to faces at the physiological level. They demonstrated that humans are particularly receptive to faces. In terms of recognition, participants in their studies were more responsive to real faces than to abstracted line faces. They speculated, however, that people spend longer studying abstracted line faces and may find them more interesting (Gregory et al. 1995). If this is so, then contrary to theories of information design, an abstract face may introduce more distraction into the communication than a realistic face.”

Filemaker Pro 7 provides multimedia container fields that enable me to include still images, animations, or even video clips.  However, not only is creating a unique graphic for each response time consuming, motion video files can be quite large and slow down the delivery of response information over the web.  Working with other agents, I had noticed that just the slight eye movement of a blink can be enough to reinforce the illusion of a sense of presence. This approach straddles the two opposing theories described above.  I would utilize a real face to capitalize on the human receptivity to a real face but keep animation to a minimum to reduce distraction.  I also think the use of a real faculty person’s face serves to reinforce the bond between the instructor and the student. A blink is also very easy to create from any faculty portrait.

I use an inexpensive animation tool called Animagic GIF Animator.  I begin with a portrait of the faculty member.  I open it in Photoshop (any image editor would suffice) and, after sampling the color of the skin above the eye, I paint over the open eye.  Then I open an unedited copy of the portrait in Animagic, insert a frame and select the edited version of the portrait.  I then set the open eye frame to repeat about 250 times and the closed eye frame to repeat once.  Then loop the animation.

I created a related table that stores all unique information about each agent including their default image, their default greeting, their login password, their area of expertise, their email address and their homepage URL. I also developed a collection of alternate avatars to use for agent images in case some faculty were camera-shy.  These were created with Poser using their ethnic character library.

Finally, I designed the login screen where the student selects the tutor to whom they wish to converse.  Upon selecting the tutor and pressing the button “Begin Conversation”, the student is presented with the query screen including the individual greeting for the tutor selected.  

I also provided a button for the faculty to use to login to edit their agent.  It takes them to a layout that prompts them for a name a password. 

Famed World War II cryptographer, Alan Turing, held that computers would, in time, be programmed to acquire abilities rivaling human intelligence.

Alan Turing at age 16.
“As part of his argument Turing put forward the idea of an 'imitation game', in which a human being and a computer would be interrogated under conditions where the interrogator would not know which was which, the communication being entirely by textual messages. Turing argued that if the interrogator could not distinguish them by questioning, then it would be unreasonable not to call the computer intelligent.” – The Alan Turing Internet Scrapbook 

My virtual professor may not be as sophisticated as agents that have been developed to pass the Turing Test but I hope I have provided a framework for the development of a rigorous inquiry-based learning system.

“Effective inquiry is more than just asking questions. A complex process is involved when individuals attempt to convert information and data into useful knowledge. Useful application of inquiry learning involves several factors: a context for questions, a framework for questions, a focus for questions, and different levels of questions. Well-designed inquiry learning produces knowledge formation that can be widely applied.” - Thirteen Ed Online.


McArthur, David, Matthew Lewis, and Miriam Bishay. "The Roles of Artificial Intelligence in Education: Current Progress and Future Prospects".  1993.  Rand. < >.
Doyle, Patrick. "Believability through Context Using "Knowledge in the World" to Create Intelligent Characters." Trans. SIGART: ACM Special Interest Group on Artificial Intelligence. International Conference on Autonomous Agents. Session 2C ed. Bologna, Italy: ACM Press    New York, NY, USA, 2002. 342 - 49 of Life-like and believable qualities.
Haddad, Hanadi, and Jane Klobas. "The Relationship between Visual Abstraction and the Effectiveness of a Pedagogical Character-Agent." The First International Joint Conference on Autonomous Agents & Multi-Agent Systems. Bologna, Italy, 2002.

Wilson, M. "Metaphor to Personality: The Role of Animation in Intelligent Interface Agents." Animated Interface Agents: Making them Intelligent  in conjunction with International Joint Conference on Autonomous Agents. Nagoya, Japan, 1997.

Stappers, P., Keller, I. & Hoeben, A. 2000, ‘Aesthetics, interaction, and usability in
 ‘sketchy’ design tools’, Exchange Online Journal, issue 1, December, [Online],
[2004, August 3].

Bruce, V., Cowey, A., Ellis, A. W. & Perrett, D. L. 1992, Processing the Facial Image.
 Oxford, UK, Clarendon Press.

Hay, D.C., Young, A.W. 1982, ‘The human face’, in Normality and Patholgy in
 Cognitive Function, Ellis, A.W. ed., London, Academic Press, pp. 173-202.

Gregory, R., Harris, J., Heard, P. & Rose, D. (eds) 1995, The Artful Eye, Oxford
 University Press,Oxford.

"Thirteen Ed Online: Concept to Classroom".  2004.  Educational Broadcasting Corporation. 8/9/04 2004. < >.

Hodges, Dr. Andrew. "The Alan Turing Internet Scrapbook".  Oxford, 2004.  (3/15/2004):  University of Oxford. 8/09/04 2004. < >.

Monday, January 06, 2014

Roku services far superior to TV Manufacturers' Built-in Apps

A technology resource article by  © 2014

This morning I read an article in the New York Times proclaiming that TV manufacturers are counting on smart TVs to boost lackluster sales.  I doubt seriously that adding internet connectivity directly to each TV is the silver bullet they're all looking for with all of the current "smart" options consumers already have.

I was one of the early adopters of Roku's video streaming device back in 2008.  I used it successfully with only a standard DSL internet connection on a Mitsubishi projection TV that was over ten years old.  Then four years ago, my husband and I purchased a 3-D Samsung Smart TV after being intrigued by James Cameron's "Avatar" the year before and deciding it was finally time to make the next leap to HD TV.  It came bundled with a 3D Smart Blu-Ray player as well.  I had also purchased a "less" smart Samsung HDTV for my office that could download files from my remote PC but could not talk to the internet (a Black Friday special at the time).So, I moved my Roku player to my office to make the TV there internet "smart" and used the applications on the smart Blu-Ray player in the living room to watch Netflix there.

But, my husband, who has become progressively more and more hard of hearing, became frustrated with watching Netflix streaming movies without the ability to turn on subtitles to serve as closed captioning like he does with the Netflix DVDs that we get by mail.  I thought Netflix just didn't provide subtitles with their streaming services.  Then one day I was reading an article that pointed out the Roku device's ability to provide subtitles with its streaming content.  I had not realized the absence of subtitles was a factor of the application you were using, not Netflix itself. Furthermore, I had purchased some DVDs from Amazon and was offered the ability to watch a digital copy until my DVD arrived using Amazon's Instant Video service but neither my "smart" TV or my "smart" Blu-Ray player offered an application for Amazon Instant Video.

During the holidays in 2012, Roku offered their latest HD streaming device on sale so I purchased one. I registered my new Roku device with Netflix and read up on how to set subtitles up on the Roku.  Then I connected to Netflix and selected a movie to try it out.  Voila!  Subtitles appeared just like they do when you select subtitles for a DVD!  I also now had access to Amazon Instant Video and a wealth of other channels including the History Channel's new online offerings.

I surmised from this experience that TV manufacturers view apps as secondary and don't have the interest or resources dedicated to improving and/or updating their "homegrown" applications.  But the streaming experience is the sole reason Roku exists, so the folks at Roku are constantly working on adding new features and more content.

The NYT article did mention an alliance between Roku and several TV manufacturers that will enable TVs to come equipped with a Roku embedded application.  As long as Roku is managing the features and content, this could work well but it is hardly a reason for anyone to buy a new HD TV if they already have one as long as Roku, Chromecast, Apple TV and other internet enabled devices are available for less than $100 (or, in many cases, less than $50).

Enhanced by Zemanta

Tuesday, September 03, 2013

Saving money with VUDU At Home

Vudu, Inc.
Vudu, Inc. (Photo credit: Wikipedia)
A technology resource article about the VUDU At Home streaming media application by  ©2013

I adopted VUDU as my movie collection cloud service last year with my fingers crossed that it would remain viable, especially as a subsidiary of retailing giant Walmart.  A few months ago I received an e-mail from VUDU asking me to try their new VUDU At Home application that would let me use my own computer to scan my DVDs and license them for my digital cloud collection.  The kicker was that if I scanned at least 10 movies in a session, I would only have to pay 50% of the digital conversion fee.  I found this a really attractive offer since I had an extensive library of standard definition DVDs that cost me $5 each to convert to a high quality streaming digital copy if I took them to Walmart for verification.

So, I downloaded the app onto my HP 64-bit Windows 7 workstation, collected my stack of DVDs that I had verified were available for Disc to Digital conversion, and prepared to scan my first disc.  Unfortunately, regardless which disc I tried, I received the error that the application could not read the disc.  That was not a good start.

I reported the problem to VUDU and they had me submit a trouble ticket that soon disappeared into the dark hole of a tech support queue, never to be seen or discussed again.  I wasn't willing to give up this opportunity to save a substantial amount of money though, so I thought I would try the app on my husband's Lenovo laptop.  Voila, it installed and functioned without a hitch and I was soon scanning dozens of my DVDs and converting them to HDX for only $2.50. (I wish I had a Blu-Ray drive on that laptop.  Then, I would only have to pay $1 for my Blu Ray discs!)

I only ran into a few DVDs that could not be read and my research on the VUDU At Home discussion forum revealed that there were some titles that were apparently missing from the GraceNote database that was being used by VUDU to verify discs.  I reported the titles and their UPC codes to GraceNote as well as VUDU.

日本語: Wm-license-own-work
Gracenote log  (Photo credit: Wikipedia)
I received a canned reply from GraceNote telling me I should report the problem to VUDU and essentially brushing me off. But I sent back a reply explaining that the problem had already been reported to VUDU and I was providing the metadata to GraceNote so they could amend their database.  (After all, I used to be a database designer!) Then I received an email back from GraceNote telling me that VUDU had only bought certain versions of their metadata and that it was VUDU's problem not GraceNote's - typical inter-company tech support finger pointing.

Oh well, at least I saved by my estimate about $320 in digital conversion fees using the VUDU at home application.  I would encourage VUDU to keep the discount program in effect after the end of the public beta as it serves as the carrot to get people to scan their own discs as opposed to running down to Walmart with them where many of the photo center staff have little or no experience with the VUDU verification process and often take 30 - 45 minutes to certify the discs then stamp them to deter people from sharing their discs with their friends and neighbors for their VUDU registration.

One other observation about VUDU's digital delivery system.  Lately, I always check VUDU's direct purchase price and compare it with Amazon's every time I want to purchase a movie.  With the exception of 3D movies (which for some reason are never offered to consumers as a digital copy despite the fact that VUDU will rent and can stream 3D movies), I now see no reason to buy a physical disc unless it is significantly cheaper.  I do wish the digital version was less expensive, though, as it should be, instead of almost equal or equal to the same price as a physical disc.  I realize this is probably the result of licensing contracts with the studios but it hardly takes into account the cost savings of not having to physically produce and distribute a disc.  The movie studios must have taken lessons from the e-book sellers who think they should be paid as much for a download file as a physical hard copy book.  This type of fattening the profit margin only leads to more people willing to purchase pirated merchandise in the long run as the RIAA discovered in the music industry.  If digital-only versions of films were priced at $9.99 or less, you'd see a lot more people buying digital in the first place than scrabbling through bargain bins or searching the secondary market for their favorites.

Related articles

Enhanced by Zemanta

Wednesday, September 12, 2012

Adaptive advertising invites depressive stereotyping

English: Detail of a New York Times Advertisem...
Detail of a New York Times Advertisement - 1895  (Photo credit: Wikipedia)
"Data-driven discovery is tech's new wave" touts a recent article in the New York Times. The article points out that developments in computing power coupled with inexpensive data storage has produced a digital "boiling point" that will enable companies to begin surgically targeting consumer groups based on incisive analysis of web browsing "trails" and age, gender and interests profiles using machine-learning algorithms.  One company they mention is  Rocket Fuela four-year-old Silicon Valley start-up that uses artificial-intelligence software to place display advertisements for marketers on the Web .  So I visited the company's website to see how they describe the service they offer to their own clients.

Rocket Fuel points out that they have defined over 20,000 audience segments that I assume are applied to vast numbers of potential client customers.  I was hoping they would define a retirees segment online so I could see how much of their profile applied to me.  Unfortunately, they didn't detail that demographic group but they did describe others with which I share some attributes.  Here are those segments with my take on their validity based on my own preferences.

Gadget Geeks technology early adopters who are passionate about gadgets
  • Passionate about technology and gadgets - yes
  • Enjoy sharing tech expertise with family and friends - sometimes (I don't like being tech support for friends and family - after all I used to do that for a living and retired to get away from it!)
  • Prioritize quality and brand when shopping - as long as I get bang for the buck
  • Interested in researching and buying the newest gadgets - research yes, buying - not usually a "" release and not unless the gadget offers perceived value based on my needs
Leisure Travelers love to travel for pleasure and frequently hunt for travel deals
  • Passionate about travel and travel deals - yes if in my preferred travel area and not a cruise
  • Frequent fliers - yes
  • Enjoy researching about travel online - yes
Not bad so far but how about less niche-oriented segments?

Value Shoppers are budget-conscious shoppers seeking value and quality
  • Research online for deals and coupons - only if I have a product already selected
  • Interested in sweepstakes and contests - no
  • Primary grocery decision-maker, coupon clips, bargain hunts - yes, sometimes and only if bargain information is delivered to me (email) or readily available without extensive research
Moms-on-the-Go are career-oriented and thrive on time-saving products
  • Socially active and web savvy - yes
  • Interested in products that allow more time with family - more leisure time
  • Enjoy dining at family restaurants and steakhouses - no; prefer international cuisine
  • Frequently buy quick-fix meals and time-saving products - no box meals; prefer freshly combined ingredients at a deli or takeout
  • Altruistic, responsible, and creative psychographics - usually
It's obvious when they try to stretch their profiles over a much larger segment, discretionary preferences become more of an issue.

There is currently no consensus on how closely...
 (Photo credit: Wikipedia)
I'm not saying this development is necessarily bad.  I am the first to admit that I really appreciate the algorithm Netflix has developed to recommend movies to me based on my viewing history and expressed ratings.  Their recommendations hit the mark more and more often.  But I have rated over 1,000 movies on Netflix.  I usually only buy a car once every ten years or so and I have no particular brand loyalty.  Furthermore, I am in no financial position to "surprise" my spouse with a new Lexus at Christmas time either! (How I hate those commercials during the holidays - I feel they have been particularly tasteless during this economic recession!!)  Not that I would consider spending that much for mere transportation a worthwhile investment anyway!

As an older consumer, what I fear most is that the media I watch will become depressingly saturated with what Rocket Fuel delicately describes as "senior products".  It already seems like I hear about nothing but incontinence products, sexual dysfunction, medications for all kinds of diseases that befall an aging body, hair loss, wrinkle creams and face lifts, Alzheimer's care centers and estate planning.  It makes me wonder if DISH network has already begun a campaign of adaptive advertising.  Maybe it's just because the educational programming we watch in our household earmarks us as demographically more mature viewers.

After all, during the day the TV is often left on for no other reason than to provide background noise for the dogs and no "consumer" is actually watching it anyway!

What we really need is on-demand program selection so our interests are more specifically defined and we are not automatically profiled by the overall channels we watch. Furthermore, now that so many of us have smart TVs, broadcasters should take a cue from Facebook and give us the opportunity to give ads a thumbs up or thumbs down then remove all ads for products that we have indicated we are absolutely not interested in.  Of course that would mean satellite and cable providers would FINALLY have to surrender their antiquated marketing model of channel tiers!!

Related articles
Enhanced by Zemanta

Monday, August 20, 2012

Augmented Reality Apocalypse basis of new YouTube series H+

I was browsing through my newsfeed on Facebook and stumbled across a reference to a new digital series produced by Warner Brothers and being offered through Youtube instead of the typical cable or satellite services.  It's called H+ and I found the trailer really intriguing:

I'm a fan of apocalyptic fiction and a series where the apocalypse is the result of a technology gone awry is irresistible to me.  The basis for this series is a new technology where augmented reality is delivered via brain implant.  Apparently it works wonderfully well for a time until about 1/3 of the world's population (the early adopters) die leaving the management of the world to mostly people from third world nations.  I'm sure Mitt Romney would find this scenario mortifying!

It will be interesting to see how this plays out not only from an entertainment perspective but from the viewpoint of Warner Brothers who is attempting to tap into the large numbers of people who are "cutting the cable" now and resorting to online streaming as their primary source of media.

The PR says each episode will be only eight minutes long and there will be 48 episodes with two episodes released every week.  I'm a little confused about why the episodes are so short.  Although it's true most online viewers are used to relatively short videos on YouTube, the number of us with smart TVs that can watch YouTube on the big screen is growing rapidly and we would certainly prefer the more traditional episode length.  However, the director, Bryan Singer, hopes web viewers will actually rearrange the episodes and search for clues to solve mysteries almost like a dynamic real-time video game ultimately changing the way we consume video entertainment.

Singer certainly has hit upon an appropriate emerging technology to use as the platform for his new series.  Although augmented reality has been discussed for quite some time (It was a major topic at an Emerging Technologies Conference I attended back in 2006, actual implementation has been a bit slow with Google's "Project Glass"  being probably the most familiar application to date.  Project Glass involves the use of specially equipped glasses that combine information from the internet with GPS location to display data appropriate to a user's location as they move through their environment. Google had initially indicated the technology would be released in 2012 but now they are projecting a consumer grade product will probably not be available for sale until 2014.

However, smartphone users have already found other augmented reality mini-applications to be useful.  One application I recommended to the nature photographers in the Emerald Photographic Society is Peak AR.  It is an application that uses your smartphone's camera and GPS to identify nearby mountain peaks by simply pointing your smartphone's camera in their direction.

Another really useful AR app is named iOnRoad.  This app monitors such things as whether your car is straying outside your lane, advises you of insufficient headway and warns you if a collision is eminent.

Google Goggles will let you scan a painting and provide information about the artist and a description of the work.  Wikitude lets you pull up Wikipedia entries on objects or landmarks simply by focusing your camera on them. The app also finds mobile coupons and discounts for local stores.

So, the technology in Hplus is already here - just not implanted as yet.  As for the digital series plot, I would offer an alternative story line.  What if the new AR modules begin projecting frightening imagery so real looking that people can no longer distinguish real from virtual? But I guess that story line will have to wait for another day!

Update: I watched the first two episodes using the YouTube viewer on my smart Samsung TV.  The first episode was almost 8 minutes but the second was only about 4 minutes including about 1 minute of credits.  I felt like I watched more credits than program!  I see the next 3 episodes are also shorter than 8 minutes.  Come on guys!  There are a lot of us with smart TVs who don't have the "Play All" option like the regular YouTube website has and having to scroll to and start each subsequent episode is a pain - especially when they are not presented in order on the TV YouTube app search function!

Enhanced by Zemanta