IAC23: Safe Tech Audits in New Orleans!

March 28, 2023 9:00 AM to 5:00 PM ET
Safe Tech Audit: Applying IA Heuristics for Digital Product Safety Testing at IAC23: The Information Architecture Conference

Are you creating products that respect the needs and autonomy of your users? Are you concerned about how GDPR, CPRA and the proposed ADPPA data privacy regulations might affect your digital product? Would you like to learn how to evaluate your digital products for safe technology behavior?

It’s possible to measure ethical behavior of technology, and Information Architecture heuristics provide a useful testing framework. Building on the Safe Tech Audit presented at IAC22, this full day workshop will discuss the role of usability and application of Abby Covert’s Information Architecture Heuristics in technology development standards from the 2011 National Strategy for Trusted Identity in Cyberspace to the Internet Safety Labs’ ISL Safe Technology Audit. You will learn to use the framework to perform a product integrity test of a web technology of your choice.

In Part One, you will learn:

  • What are technology specifications and how are findability, understandability, accessibility and usability factors in developing them?
  • How do the various data privacy laws affect the use and control of personal data?
  • How can Information Architecture inform the design of safe and respectful apps and websites?

In Part Two, you will

  • Perform Safe Technology audits to measure product safety of a website and compare different kinds of technologies (news sites, social media, university websites, retail stores, etc.)
  • Select a website or app of your own to test and develop a plan to address any negative results (you won’t be required to share the results if you don’t wish to)
  • As a group, we will create an artifact to present on IAC23 Poster Night.

UX-LX 2023

I am also hosting a workshop on Sensemaking, Search and SEO in Lisbon on May 24 at UX-LX 2023. More details soon! Registration

Exploring a 9/11 Geographic Archive

Oral history as a primary source is being revived through initiatives like Story Corps and World Pulse and through improved storage capacity to archive and exhibit personal stories, making it less expensive for even the smallest and least funded groups. We are moving toward an environment where alternative narratives can be both manipulative (alternative facts, post truth) and expositive, as more and more under-represented groups get access to telling their story. So the ways that we share and interpret of stories in the future will be pretty interesting.

The story of the creation of the maps for first responders and emergency managers is sweeping and personal. I am currently exploring the creation of a 9/11 geographic archive. The archive will serve as a repository of artifacts and a history of participation by geographers, programers and spatial data technologists during the response to the World Trade center attack on September 11, 2001. Funding for the project was provided by the Fund for the City of New York as part of a grant to develop a Center for Geospatial Innovation.

More information and thoughts to come!

Portfolio: IDEF Registry

Client: OASIS/Identity Ecosystem Steering Group
Visit Website

My Role

I led user testing for the Identity Ecosystem Framework (IDEF) Registry as part of the National Strategy for Trusted Identity in Cyberspace (NSTIC), a White House initiative. The IDEF Registry, a digital identity standard assessment tool, launched its alpha version on June 6, 2016. Because development of the alpha version of the attestation form was ongoing, I was brought into an agile process with the goal to iterate improvements after the public launch. I worked directly with a contracted project manager, third party marketing and design companies, the Chair of the IDESG User Experience Committee and members of the IDEF Registry working group.

User Research

The goal of the user study was two-fold: first, to ensure that the assessment form was understandable to those users who wish to list their products and that it included sufficient and expected information needed to complete the form accurately, and second, to ensure that the registry listing itself was usable and understandable to users who are seeking identity solutions.

Test participants for the first goal included IDESG members and observers who provide identity services, including certification, authentication, authorization, registration and transaction intermediation, or who rely on identity services in their own internal systems and commercial products. We selected expert users because we expect that those who will be completing the attestation form have a high level of understanding of the privacy, security, interoperability and usability of their own products.

Tests included needs assessment interviews of 12 prospective users, followed by additional user tests of seven users. For the needs assessment, I interviewed 12 prospective study participants about their needs for identity standards assessment and how the current IDEF Registry assessment tool compares to similar industry and government standards. I wanted to understand if the IDEF tool addressed all of their concerns about privacy, security, interoperability and usability and to get a sense of whether the planned registry served their needs. General findings were presented in a Google slide presentation showing typical responses to eleven study questions, suggested improvements and the impact on the user expereince. These were discussed over two, 2- hour meetings of the IDEF Registry Working Group.

Usability Tests

After delivering my findings to the development team, I began to design usability tests. I employed an observational walkthrough of proposed and completed designs, an expert heuristics review, user surveys and follow-up interviews with seven registry users. I utilized card sorts, preference tests, cognitive walkthrough of wireframes and a live website, as well as observations and survey feedback of seven alpha site users as they completed the attestation form on the alpha website to develop recommendations for improvements.

I engaged four members of the User Experience Committee, all usability experts, to participate in a heuristic analysis using Neilsen-Norman Group’s 10 usability heuristics and Abby Covert’s IA Heuristics. These expert users primarily evaluated the assessment form, but also provided input on the usability of the registry listings themselves, as a proxy for typical registry listing users. Due to the early stage of development, the client did not wish to

Results

The results showed that while the IDEF was rigorous, the implementation of the assessment and registry listings needed improvement, particularly to address situations where more than one person or company department might need to be involved. There were a number of issues with the interface including layout and data visualizations that could use improvement. Since Usability was a major component of the assessment, I also developed a set of user experience guidelines and metrics for service providers to use in evaluating usability requirements of the attestation. These will be incorporated into the Usability section of the assessment guidance documents.

UPDATE (5/22/2017): As of late Spring 2017, nine companies have completed assessments. The website remains in alpha with my recommendations set for implementation when the next round of grant funding is approved. Should I be reengaged, the next studies will include user tests of participants seeking identity services.

UPDATE (6/15/2019): The Registry is currently 65% complete and has transferred to the Kantara Initiative’s Education Foundation as of December 2018. I am continuing to serve on an agile advisory team and am working on use cases for health care. I presented the registry and participated in roundtable discussions at the 2019 Health Information Summit in Washington, DC on June 4, 2019.

Note: I signed a Non-Disclosure Agreement and am unable to share any images aside from those made public at idecosystem.org and idefregistry.org. Detailed information about the project, the assessment and the User Experience Committee is available on the public IDESG Wiki. Some of the documents including a draft rewrite of the Usability Guidelines and Metrics have been made public at: https://wiki.idesg.org/wiki/index.php?title=Talk%3AUser_Experience_Guidelines_Metrics

Announcement:
The IDEF Registry: an open invite to commit to trusted digital identity solutions

Resources:
Identity Ecosystem Steering Group (IDESG)
IDEF Registry
Identity Ecosystem Framework – Baseline Functional Requirements

Announcement:
The IDEF Registry: an open invite to commit to trusted digital identity solutions

Resources:
Identity Ecosystem Steering Group (IDESG)
IDEF Registry
Identity Ecosystem Framework – Baseline Functional Requirements

Map Mosaic: From Queens to the World

Amy Jeu and I curated a weekend exhibit, Map Mosaic: From Queens to the World, on October 29-30, 2016 at the Queens Museum celebrating the map-making community. The event featured talks and demonstrations as well as a hall dedicated to paper and digital maps submitted from the private collections of members of the GISMO community. These maps represent a wide range of themes including the diverse Queens neighborhood and demographics, urban planning, environmental studies, election analysis and more.

Visitors at Map Mosaic: From Queens to the World, Queens Museum, NY
Mezzanine Level with map exhibit and children's activity tables at Map Mosaic: From Queens to the World, Queens Museum, NY
Mezzanine Level with map exhibit and children's activity tables at Map Mosaic: From Queens to the World, Queens Museum, NY
Five maps with placards at Map Mosaic: From Queens to the World, Queens Museum, NY
Table with flyers and Dr. Suess book for children's story hour at Map Mosaic: From Queens to the World, Queens Museum, NY
Four visitors at interactive map station, one wearing 3D glasses at Map Mosaic: From Queens to the World, Queens Museum, NY
Interactive map station with 3D glasses at Map Mosaic: From Queens to the World, Queens Museum, NY

My Submissions

For my contribution to the exhibit, I created a cutout map of the 1964 World’s Fairgrounds to teach children how map layers work in GIS. This series of maps, printed on acrylic transparency sheeting can be stacked to show through various layers: Base Map, Parks, Buildings, Streets/Paths. We also provided additional paper and colored pencils for children to use. This activity helped younger visitors to understand the concept of map layers in GIS.

Because the event was held over Halloween weekend, I also contributed a set of themed maps with Halloween parade routes and a “Crime of the Century” story map retelling the activities from the 1934 Ice House Heist in Brooklyn and Upper West Side Manhattan. The piece included reproductions of aerial photographs from the time period.

Documentation

Each item in the exhibition included a placard indicating the name of the mapmaker, the materials used and a brief description of the subject. We used icons to indicate whether an interactive version was available at the computer stations or that the mapmaker is also a speaker in our forum.  

interactive

Interactive Map

speaker

Speaker

Amy Jeu created the flyer and copy for the exhibit which was published on the Queens Museum website and the signage used for the exhibit and presentations. I created the placards and the online exhibit catalog.

Archive

The Map Mosaic event was privately curated. Queens Museum published an announcement and the exhibit catalog and list of interactive maps are available at GISMO’s Website. The acrylic manipulative work is located in the GISMO archive. All maps produced by the NYC Office of Emergency Management were donated to the Queens Museum and all other, individual artwork was returned to the artists.

Queens Museum Website Announcement
Exhibit Catalog
Interactive Maps

Introducing Decision Fish

Decision Fish: The Art & Science of Decision-Making is a blog with observations and applications from decision science, behavioral economics, finance, cognitive psychology and philosophy, written by my husband, Brett Whysel. The purpose of this blog is to explore applications of these realms to real world decisions.

I have been working with Brett to refine the brand and digital presence and to scout opportunities to connect with the New York City startup community and present our idea for a new kind of decision-making process to be launched in 2016. I plan to offer my expertise in user experience design and cognitive and behavioral science in developing the application. This evening (November 9, 2015), we will be attending the Women’s Startup Challenge at Microsoft to cheer on Aileen Gemma Smith, who will be presenting Vizalytics’ MindMyBiz app.

The blog’s name, Decision Fish, is inspired by the three-spined stickleback, a fish that appears to rely on crowd-sourcing, consensus decision-making.

Gasterosteus aculeatus aculeatus

 

The logo is a fortune-teller fish made of red cellophane whose curling when placed in one’s palm is said to indicate fickleness, passion, jealousy, etc. Of course, our goal will be to help users overcome these weaknesses to make effective decisions.

Brett Whysel is a Decision Analyst, Financial Product Structurer, C-Suite Influencer and Manager with 25 Years’ Capital Markets Experience. Brett is a guest lecturer teaching Cost-Benefit Analysis at City College’s Colin Powell School of Civic and Global Leadership. You can find out more about Brett on LinkedIn.

NYPL Open Book Hack 2015

For the 2015 edition of the NYPL Open Book Hackathon, I participated with a team that was interested in pulling poetry out of Project Gutenberg and creating a user dialogue with a goal toward creating a custom book of poems, based on user preferences. We started out calling it “Pandora for Poetry,” but settled on Musapaedia to avoid obvious copyright issues.

Screen Shot 2015-01-14 at 3.48.17 PM.png

Image Source: http://en.wikipedia.org/wiki/File:Musapaedia.pdf

With Musapaedia:

User can (possibilities)

  • Upload/enter a poem and get a set of poems in custom e-book or web“experience”

  • Choose a set of attributes and get a set of poems in custom e-book or web“experience”

  • Use up/down vote system to determine what kinds of poems that come up

User Experience:

  • Poem “mood”, color/image changes with type of poem

Since this year’s edition of the hackathon was one day as opposed to two, we had much less time to complete the project than previous years, but we were able to create a sample user interface and code the processes that extract the poems. Our team will continue to work on this and hopefully release a working application soon.

Final code we completed today is on GitHub!

https://github.com/rossgoodwin/musapaedia

Team:

Ross Goodwin Ross.goodwin@gmail.com

Noreen Whysel nwhysel@gmail.com

Vimala Pasupathi vcpasupathi@gmail.com

Clarisa Diaz clarisadiaz@gmail.com

Rike Franklin rikefranklin@gmail.com

Beth Dufford emdufford@gmail

Stephen Klein stepheniklein@gmail.com

 

 

 

Stump and Moo

…and for my first piece of post-MLIS magic, I started a project cataloging cows. Literally. It’s a small cattle ranch management app and won’t be public. Mostly coding and connecting to no-SQL database MongoDB, which is based in JSON and has interesting linked data possibilities.

I have also started interning at Architecture_MPS, an online architecture journal. I am developing an image archive of presidential campaign photos from 2000 to 2012. More when there is something to show.

Fall Projects: User Research

My Information Architecture class conducted a semester-long, group project to develop a website prototype for a small business or nonprofit group. My group, including Eleanor Meyer, Jan Diolola, Storey Radziunas and me, formed a group called Community Design and selected the West 104th Street Block Association as our client. Since I have a prior relationship with the block association as the caretaker of their digital newsletter repository, I had close access to members of the association board and the community and knew that their site was in desperate need of a facelift.

We each selected a different user population to study including senior citizens and older adults, families living in the neighborhood, young families considering a move to the neighborhood and couples without children. My group presented our design to the block association, who has agreed to adopt it for their next redesign. Next step is building the thing. Congrats, Team!

Read more about this project at my Pratt SILS E-Portfolio:

Towards a 9/11 GeoArchive

Imagine if the most graphic and expressive artifacts from one of the most historic events in New York City lay rolled in tubes in a dusty corner. What if millions of bytes of geographic data, produced through an unprecedented, community collaboration, were dispersed, disconnected and hidden from public view? If you had the opportunity to preserve them, how would you do it?

During the September 11, 2001 rescue and recovery operations, I volunteered to help recruit geographers through a NYC-based GIS user group, called GISMO. The need was critical and overwhelming. The Mayor’s Office of Emergency Management had been evacuated and no longer had access to maps and data necessary for the rescue effort, and if that wasn’t bad enough, they lacked the number of skilled hands to produce the hundreds of maps per day required by the unprecedented event. At this point, GISMO had been working for years to advocate for data sharing and cooperation among city, state, non-profit and private entities, and developed into a 400 strong social network. Hundreds of volunteers, many from GISMO, stepped forward. This effort served as a highly regarded, if anomalous, model for unified response in years to come. But the artifacts from this effort have not been preserved in any curatorial sense. I’d like to change that.

I recently participated in the NYC GeoSymposium 2001-2011-2021, which took a look at the advances and challenges of Geographic Information Systems in emergency response since 2001. Around this time I had been thinking very hard about my career goals and ways to combine my past experience in research and design with the grassroots efforts of the geographic community. I had been working with colleagues at GISMO for many years to draw attention to the important role geographers played in the 9/11 rescue and recovery. The GeoSymposium was a great experience, because it intended not just to honor those who participated in these efforts, but also to highlight the need to preserve the thousands of maps that tell the story.

My own contribution to the GeoSymposium was to explore the legacy of these efforts by examining the technological improvements at the Office of Emergency Management in the context of emergency events that had occurred since 2001. I was looking for a way to present time-based information in a map format and also to start a conversation with attendees about the history of emergency response technology and the importance of the preservation of geographic artifacts. My project contained a map of New York City with events plotted and color-coded by discrete periods, characterized by a common group of new technologies. An online version of the map is available at ArgGIS Explorer Online.

OEM-Incidents-interactive-map

View Interactive Map

OEM Incident Map – Poster

OEM-Incidents-screenshotView Detail Slides (Requires Microsoft Silverlight)

The map highlights how the events surrounding 9/11 prompted improvements in incident management technology. Attendees, including the keynote presenter and eminent information designer, Edward Tufte, gathered around to discuss their experience with the events I had mapped and to offer advice on ways to enrich its design. (Some of Mr. Tufte’s comments led to further improvements which you can see via the links above.)

Simply talking about how to improve the map was an exercise in exploring history and memory: how people understand what happened, how events are related to one another, how what you choose to include and what not to include can influence a person’s understanding of the events, how the description of one event can bring to mind another similar one, etc. It was thrilling to observe the spontaneous conversation that started all because of a three by four foot piece of foamboard.

And that’s just one artifact. In the aftermath of 9/11, hundreds of maps were produced – Every Day – for months. The 9/11 geographic effort represented a level of cooperation not seen before or since, but whose legacy, coupled with improvements in technology platforms themselves, informs the open data initiatives we are now seeing throughout the U.S.

Of course, the artifacts of the 9/11 response have historical value by themselves. And that is where the images of dusty, neglected rolls of paper come in (even though most of the maps are on disks and hard drives). Several of my GISMO colleagues and I are exploring a plan to create a 9/11 Geographic Archive, featuring the maps that were produced during the rescue and recovery effort. I plan to present an outline of the 9/11 Geographic Archive and my map of emergency response technologies at the ASIS&T Information Architecture Summit in March 2012. Such an archive would be an important contribution to the history of emergency response in this country.

I have always loved presenting information in meaningful and digestible ways, whether through maps, market research reports, drawings, websites or online resource libraries and intranets. From very early in my career, I have been driven to present information in a coherent way and to seek out tools and processes that make coming to understanding easier. I am thrilled by the convergence that today’s state of technology allows between geographic tools and the digital storytelling of the user experience discipline. What is really great about this project is that I will be able to combine aspects of two fields that I love into an end product that would have meaning for many now and in years to come.

So, if you had the opportunity to preserve artifacts from an important event in New York City history, how would you do it? Some of the groundwork has already begun. I have been working with a mentor to explore relationships with organizations that support technology projects in the digital humanities, and with museums and libraries that share an interest in geographic artifacts and 9/11. I am building on my relationships with the City’s amazing geographic community through GISMO, the thirty Geosymposium presenters who told the 9/11 story and senior staff at the Office of Emergency Management and other consultants who have expressed interest in an archive. (I have even applied to an information science program where I hope to explore this project further). Finally and perhaps most importantly, I have the support of members of the GISMO Steering Committee to pursue further resources and trainings to develop the framework for an archive entity. With that grounding, I can turn the question “How would you do it?” into “When can I start?”