The tools we use: Gahhhh, where is the killer qualitative analysis app?


For the August issue of Ethnography Matters, Jenna, Heather, and Rachelle have written great posts about their fieldnote tools in the Tools we Use series. Now I have all these new apps I want to try for data analysis!

So this is when I admit here that I have no perfect process. I really don’t. Sometimes this upsets me and sometimes I just say whatever.  I’ve only figured out parts of the process. For example, last month, I wrote in depth about my use of Instagram to live fieldnote. But that’s just one part of the long path of fieldwork analysis. Now that I’ve finished data gathering,  I am no longer in the excitement of fieldwork. I don’t have a team of people to work with as I usually do on projects. For my China research,  it’s just me. And all I can think is, how am I going to analyze all this data without going crazy?

I’ve tried all the coding software possible for qualitative research, but there is no app that fulfills my needs. I have developed an aversion to anything that claims to be a “qualitative analysis tool.” These tools are lacking in user friendliness, collaborative features, platform diversity, and service support. If it doesn’t run on a mac and if the software’s website is unusable – that’s already a clue.

As far as fieldwork tools go, hardly anything drives an ethnographer more crazy than trying to find the most appropriate fieldwork tools. Of all the ethnography courses I’ve taken and all the books, dissertation, and papers I’ve read, none of them go into depth on the tools that ethnographers use to support their process. I suspect that one of the reasons why ethnographers don’t write about the tools they use is because they may use an ad hoc process that is messier and less structured than they’d like to admit.

Short of making the dream killer qualitative data app myself, I have to reply on a my very ad hoc, imperfect, and ever changing process (but I’m still holding out for that perfect kill qual app!)

I use different tools when I conducting participant observations and formal interviews.

Participant Observations

I totally rely on my iphone to document participant observation. (my transition from a feature Nokia phone to a smartphone)
  • iPhone camera and Instagram: I take pictures first in the iPhone camera and I live fieldnote some of the pictures to Instagram.
  • iphone notes app: this is a non-disruptive way to take notes and if you are on a 3G connection you can sync it to gmail, which makes me feel releived to know that I’m constantly backing up. I often show my screen to the participant to let them see that I am taking notes and not doing anything else.
  • Instant Messaging (text, what’s app, weibo, we chat or tweet): I copy and paste all correspondences into the participant’s Evernote file.

Interviews

  • a large notebook: I take notes with a pen and a notebook during an interview. I find that using a notebook makes it more personal and feels less transactional. It would be so much easier if I could type into an ipad or laptop, but it depersonalizes the interaction. And like Rachelle, I often ask my participants to draw out what they are describing in the notebook. But I don’t bring colored markers like Rachelle brilliantly suggests!
  • Olympus WS-710M Audio recorder: I know everyone loves the Zoom Audio Recorder, but I find it too clunky. I prefer the Olympus because it’s discreet and has a retractable USB drive which means that it’s one step less to transfer the audio onto my drive

Organizing Fieldwork data:

  • I copy and paste my iPhone notes from my gmail “notes” folder (all iPhone notes are synced to gmail) to my evernote folder “daily fieldnotes”.
  • I write daily fieldnotes on my computers in Evernote.
  • I have an Evernote folder called, “Participants”. I  create a file on each participant and assign them a number with the city I met them in. For example, 10_BJ is participant #10 who I met in Beijing. I drop in any pictures I’ve taken on my cellphone or Canon S100. I write a participant summary and includes info on where and how I met the participant and their contact information. I tag each participant’s file so that it will be searchable.
  • I print each participant’s picture along with a summary and put it on a wall.
  • I sticky note like crazy – it’s how I sort out my ideas and make sense of the mess in my head.
  • I use Mendeley and was an early fan of it, but I have to admit that as they have scaled, they have not been great on responding to the community’s issues quickly. I am a community adviser and even I am a bit frustrated on feedback time. I echo Heather’s experience with Mendeley, but that being said, I still prefer it over to Zotero simply because it just works much faster , I don’t care for Microsoft Word plugins. I like the social aspect of Mendeley, and you can share reading lists (like we have done here at Ethnography Matters – you can join our list of Ethnographic Monographs!).
And that is as far as I’ve gotten – I will be going into analysis these next few months and will share my new system once I figure it out!
Even though I am working on a new process this time, I’ve conducted a lot of previous fieldwork and post-fieldwork analysis, and I’ve learned about some things that work for me:
  • Complex software can get in the way of analysis.
  • Sometimes, all you need to do is print out your fieldnotes, take a highlighter, and talk it over with yourself or with someone else.
  • Big walls are important – I’ve found that I need lots of wall space to spread my ideas out.
  • Recreate fieldisite with pictures – print out pictures of your fieldsite and participants and hang them up on a wall, it helps put my brain and heart back into my fieldsite.
  • Find a colleague/friend to talk over your analysis and make this a regular thing – this is SOOO important. Don’t just find a writing group, create a data analysis group!
  • Bring multiple batteries for all your devices during fieldwork.
  • Always have an overload of sticky notes of diff colors and sizes.
  • Carry sticky notes with you everywhere you go. Write down ideas and concepts onto the notes and then when you go home, stick them onto the wall. Reorganize your wall every time you re-conceptualize your process.

Despite listing all those tools to support my ethnographic work, I firmly believe that the most important tool is your energy.  Whether you do fieldwork online and offline, both you and your participant establish a relationship by weaving together a net of trust.

And I find that the fastest way to weave this net is through a smile  or a 🙂 that shows that you are totally present in that moment. It’s unbelievable what happens when people feel that you are genuinely interested in hearing their stories – they end up sharing their world with you.

Energy is not something that is taught in Ethnography or Design Research 101, it’s cultivated as part of your daily practice to be a human being in this world. And ultimately, that is who we are studying, so it’s not a bad thing to become more human.

What fieldwork tools do you use? What works for you? Tell us in the comments or contribute your process to the Tools we Use series!

UPDATE September 7, 2012:

People have suggests in the comments, tweets and fb messages to  look at Moment App, Dedoose, Ethos, and Capture Notes. If anyone has tried any of these, please let us know your experience! I took a look at Ethos and I couldn’t get past even setting up a project. I found it totally unusable. Moment seems good for self-documentation, but it’s not sharable. Capture Notes is only available on the ipad, it’s not mobile friendly and since I don’t incorporate the ipad into my fieldwork I can’t use it. I would love to try Dedoose but it seems to require more sit down time!

UPDATE September 9, 2012

Some readers thought I wanted a “killer” app that would perform analysis. This is definitely not what I meant! I want an app that supports me in my ethnographic work by managing my data. I don’t want an app that does coding or even helps me do ethnography. If Geertz were still alive, he would ask where is the killer notebook. The killer qualitative app would just be another tool for ethnographers to record data. Just like how no notebook could ever replace an ethnographer, neither could an app.

_______________________________________________

Read other posts in the Tools We Use series:

Tags: , , , , , , , , , , , , , , , , ,

30 Responses to “The tools we use: Gahhhh, where is the killer qualitative analysis app?”

  1. Sam Ladner
    September 5, 2012 at 5:55 pm #

    Tricia, have you considered Nvivo? I agree with you that most software is too complex, and I’m not recommending Nvivo. Once upon a time, I was an Nvivo whiz, and now? It’s too complex for its own good. It’s collapsed onto itself.

    There’s also dedoose, which I’ve been dying to try, but haven’t had the need yet. I hear good things about it.

    • September 5, 2012 at 7:11 pm #

      Sam I despise Nvivo – I tried to become a Nvivo whiz 🙂
      But I failed – and I realzied it wasn’t me! It’s unusable. Have you seen their website? it’s impossible to navigate so that already makes the software unusable for me.

      I just checked out Dedoose’s site – do you know of anyone using it who could write a review? Thanks for the tip – the website is navigable – so that’s a plus! 🙂

  2. September 5, 2012 at 6:00 pm #

    This is incredibly useful + has me thinking about what would be on the killer app wishlist… Along with user friendliness, collaborative features, platform diversity, and service support, I would want it to be thoughtful and explicit about ways of handling confidential information.

    Doesn’t seem like anything out there combines all of that.

    • September 5, 2012 at 7:12 pm #

      let’s turn ethnographymatters into a corporate spinoff so we can make our dream qual app!

  3. September 20, 2012 at 7:34 pm #

    Great post! I have often found myself asking the exact same question. I have used Atlas.ti in the past, but since it is so loaded with functionalities, people end up using it as an advanced database. Well, I’ll get back to looking for that sleek, intuitive, collaborative app that works across platforms and data-sources and which doesn’t require a PhD in data-mining to work with…

  4. Joshua
    October 16, 2012 at 2:18 pm #

    Have you tried Fulcrum? I used it recently in the field and aside from having to use it on an iPhone, it was excellent. The flexibility in setting up forms is really great. I had a form setup with a basic biographical survey. I could type in the info I needed, record an interview, take a photo of the participant, and log their GPS coordinates, all from the same simple form.

    • March 27, 2013 at 3:54 pm #

      hey Joshua – have you written up your process anywhere? I’d love to explore Fulcrum!

  5. JF
    November 27, 2012 at 10:23 pm #

    See also QDA Miner Lite. It’s a free computer assisted qualitative data analysis software. This new freeware provides an easy-to-use tool for coding, annotating and analyzing collections of documents and images such as interview or focus-group transcripts, journal articles, web pages, or customer feedback.

    QDA Miner Lite has been designed to meet the basic needs of researchers and analysts performing qualitative data analysis. This CAQDAS tool is ideal for those on tiny budgets (or no budget) or those who wish to teach qualitative research in classes.

    For more information go to: http://provalisresearch.com/products/qualitative-data-analysis-software/freeware/

  6. Paul Dupuis
    January 27, 2013 at 4:30 pm #

    Have you looked at HyperRESEARCH from Researchware (www.researchware.com). It was developed for the Mac in 1990 and has remained on the Mac ever since.

  7. March 28, 2013 at 11:14 am #

    Can anyone recommend an app for capturing social media pages (e.g. http://www.facebook.com/events/574333722596462/ ) as pdfs? On windows.

    Thanks

  8. JF
    September 6, 2013 at 8:16 pm #

    For your information, Provalis released QDA Miner Lite v1.2. It’s a new update of the free version of the computer-assisted qualitative data analysis software, QDA Miner. For more information, visit: Free qualitative software

  9. September 12, 2013 at 6:22 pm #

    Hi Tricia – This is a great post! Full disclosure, I work at Dedoose (www.dedoose.com) and want to help. If you have not yet given Dedoose a shot, we would love to have you give it a try (free for 30 days) and share your thoughts on how to improve it for ethnography. We were actually founded with ethnography in mind as one of our Co-Founders is an anthropologist. His name is Dr. Tom Weisner. If you just want to take a peek around the tool, our CEO (and the other Co-Founder) Dr. Eli Lieber offers free one hour demos with small groups online every Tuesday. This way you can ask any questions you might still have for us. We are really glad that you are doing so much research on the best tool for your work! Here is the link to our blog to sign up for our demo: http://blog.dedoose.com/2013/08/free-dedoose-demos/

  10. Ryoko Imai
    September 23, 2013 at 9:59 pm #

    I’ve used Dedoose for interview data a while back, and loved it. But I’m not sure if it would work just as well for ethnographic data. I am now learning to use atlas-ti, and not liking it at all…

  11. Charlotte S
    August 1, 2014 at 4:53 am #

    Hi all,

    Has anyone tested different iPhone recording apps? I am looking for a reliable app to record focus groups of 4-5 people in rooms with quite but some background noise (think like classroom with school yard outside). All I need is a simple app that records the sound clearly and then I can upload to my computer right after, preferably with a usb rather than wifi.

    Any suggestions or comparisons?

    Thanks!

  12. November 3, 2015 at 7:28 pm #

    Raven’s Eye (http://ravens-eye.net) analyses textual natural language in seconds. Invented by researchers immersed in qualitative methods, Raven’s Eye outperforms other computer-assisted qualitative data analysis software (CAQDAS) programs in a number of ways. It’s available online through a Software-as-a-service model, so in addition to Mac & PC desktops, you can access it on phones, tablets, and laptops. Until November 30th, 2015, we’re giving out free 30-day trials to anyone who already owns a CAQDAS program. We’re sure you’ll like us.

    • Researcher/consultant
      July 13, 2017 at 7:53 pm #

      I have used Raven’s Eye for research and work. It is super user friendly. You can access and analyze data on a phone or computer! They have 40 languages to analyze data with which is helpful for me as I have data in English and Spanish. It has a lot of features to choose from. I like that I can download the results easily.

  13. Dilan
    April 26, 2016 at 9:17 pm #

    Hello, has anyone used atlas.ti for data-analysis? I ended up having lots of codes and ned to visualize some data in my research. I will be so glad if you can share your experiences with me. Best, Dilan

    • Rachelle Annechino
      April 27, 2016 at 11:21 pm #

      Hi Dilan – I’ve used ATLAS.ti. It has some nice visualization features, very oriented toward grounded theory. It’s a little unwieldy for collaborating with a team if that’s something you need to do – but if you take the time to check out the documentation, it’s manageable. If you’re looking for visualizations that are more driven by a mix of qual+quant data, Dedoose might be worth checking out (although they did have a pretty big data loss a or so year ago – hopefully things have improved since then – but yeah) –

  14. WML
    December 18, 2016 at 2:06 am #

    I’ve been using a software called Quirkos (www.quirkos.com). I don’t think it was in existence at the time of your post. It handles my QDA needs.

    WML

  15. December 20, 2016 at 5:22 am #

    Hi Tricia!

    I’m building a new platform for user research called Dovetail. The goal is to make it easy for researchers to collect data using a variety of methods, analyse the data, and share their findings with colleagues. At the moment Dovetail is in a free beta and the focus is specifically on diary studies, so it should work well for you.

    I’m hoping the researchers who join the beta can help me shape the future of the product. So if you’re a researcher, please take a look at https://getdovetail.io. Thanks!!

  16. James Camden
    February 15, 2017 at 12:06 am #

    I know it’s a little late to respond, but I’ve been using Dedoose exclusively for almost 4 years now, and can’t imagine having to deal with nVivo or (to a lesser extent) MaxQDA again. Aside from the performance, functionality and bonus of being both Mac/PC-friendly, It’s nice only having to pay a monthly subscription cost I can turn on and off as needed.. the $10 a month seems like pocket-change compared to the ridiculous over-priced license fees most other software providers employee.. which also conveniently don’t include “major” upgrades. I left nVivo in disgust after they had the gall to charge me for a “New Version” that really only fixed errors that came with the original $1200 price tag.. Seems odd I should have to pay for “updates” that are actually pre-existing bugs I payed for once already.

    Haven’t tried Quirkos, but I’ve heard mixed reviews – mostly positive, but they seem to lack some functionality that a lot of other providers (heck, even nVivo!) have already implemented.. While i wouldn’t be opposed to giving it a shot, think I’ll stick with Dedoose for the time being.

  17. February 20, 2017 at 4:45 am #

    I realize I’m commenting years after this was initially published, but I found this post really helpful and wanted to add, for any subsequent readers, that I find Annotations for Mac quite helpful. It’s a quick and dirty coding tool that’s cheap, easy to use, and fills a nice gap between more complex coding software and nothing at all. I use it quite a bit in the field right now.

    Thanks so much for listing out your approach here: as a relative newbie to ethnographic methods, I found this nuts and bolts description really, really helpful.

  18. April 26, 2018 at 8:24 am #

    Bonjour,

    J’ai fait ma thèse sur Atlas.ti puis basculé depuis sur Nvivo pour mes nouvelles recherches. Je préfère aujourd’hui Nvivo à tout autre CAQDAS.
    En plus, Nvivo est beaucoup moins compliqué qu’il n’y parait une fois qu’on a eu une petite formation à l’outil. Il est bien plus agréable que MaxQDA et propose plus de fonctionnalités que Dedoose.
    Pour commencer, n”hésitez pas à visiter le site http://www.nerdyscholar.com qui propose un tutoriel pour les débutants sur Nvivo.

Trackbacks/Pingbacks

  1. The tools we use: Supporting Wikipedia analysis | Ethnography Matters - September 5, 2012

    […] The tools we use: Gahhhh, where is the killer qualitative analysis app? […]

  2. The tools we use: Bring some colored markers | Ethnography Matters - September 5, 2012

    […] The tools we use: Gahhhh, where is the killer qualitative analysis app? […]

  3. The tools we use: Beyond Cassette Tapes | Ethnography Matters - September 5, 2012

    […] The tools we use: Gahhhh, where is the killer qualitative analysis app? | Ethnography Matters – September 4, 2012 […] Jenna Burrell’s The tools we use: Beyond Cassette Tapes […] […]

  4. Ethnozine: August Edition – the tools we use, ethnography of Occupy, EPIC12 preview, men peeing, & uprooting assumptions | Ethnography Matters - September 5, 2012

    […] field. Rachelle Annechino suggests a few Android appsalong with colored markers and Tricia Wang tells us about her anxieties of not knowing which tools she’ll use for her analysis […]

  5. Diseño de Interfaces y Experiencias de Usuario – Sistema de Bibliotecas CETYS - June 17, 2016

    […] Wang, T. (2012). Las herramientas que utilizamos: Gahhhh, ¿dónde está el asesino aplicación de análisis cualitativo? En Ethnography Matters. Recuperado de http://ethnographymatters.net/es/blog/2012/09/04/the-tools-we-use-gahhhh-where-is-the-killer-qualita… […]

Leave a Reply