| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

View
 

Test Development Team

Page history last edited by Dan Mo 7 years, 9 months ago

 

Team

  • Bill Corse     Team 3 Design      wcorse@wismail.net         skype: william.corse
  • Erica O'Neil     Team 7 Design      ericaloneil@gmail.com       skype: daytripperoneil
  • Barry Deron  Team 2 Design   bjd70gt@yahoo.com         skype: bderon60
  • Eric Souare      Team6     hsouare@gmail.com          skype: cocody7
  • Marcelina N.    Team5     marcelina.now@gmail.com  skype: poormrcat
  • Marcell Babai   Team1     marcellbabai@gmail.com   skype: marcellbabai
  • Basharat Laghari  Team8  blaghari@gmail.com           skype:  blvt440
  • Dan Morales  Team4     dmoral522@gmail.com    skype:   dan.mo2

 

  • Danny Mitttleman     skype: dmittleman 

 

Online Survey Link:

https://docs.google.com/spreadsheet/viewform?formkey=dGhHN3IwZVV6YnJISHB6RFY3akxvVGc6MQ

 

Completed Online Survey Link (Round 1 Testing):

Copy of Copy of 440 conference survey raw output mar 7 eve - 79 responses.xml

 

 

Roles

1. Each person is liaison back to their own team to gather testing requirements and validate question wording against that platform

2. Someone to host a shared Google Docs survey

3. Scheduler/Coordinator

4. People/person to "own" each story the team wants to pursue and make sure questions are generated

5. Someone to "own" the demographic questions - also questions about the system - questions about connectivity

6. Someone to write a draft of the overview testing "invitation" that testers will read

7. Data analysis?  Or do we simply give the data to each team to consider?

 

Test Plan

 

  1. Who are we testing? 
  2. What demographic variables do we need to capture?
  3. What user stories are we creating?
  4. What do we need to know from testers to find out if the user stories work?

 

Note that the way to do this is to start at the end and work backward

 

a. What UX decisions does our team need to make?

b. What information would inform each of these decisions?

c. How do we write a question so that the answer will give us the information in actionable form?

d. Lets test the question with play data and see how it guides us.  (Refine question, if necessary)


 

Some answers to the material above.

  1. We have three classes of testers:  [1] Doug's students--they are undergraduates largely unfamiliar with ICA and with virtual collaboration, but are taking a virtual collaboration course and have read up on ICA and the conference the previous week; [2] The ICA theme leaders--we will get only a few of these participating; very familiar with ICA and conference, unfamiliar with virtual collaboration; [3] virtual collaboration sisterhood--they are virtual facilitators who will be very skilled with these communities, and fairly familiar with ICA (but not the conference); we may get a half dozen of these people.
  2. We need to know which group they come from.  Lets label the group WIU Student, Global Conference Leader, Virtual Facilitator.   We need to know whether they have any experience in the platform they are reporting back on, so we also need to know which site they are reporting on (assuming we use one survey for all).  We probably want to know their experience with virtual collaboration on any platform.  Can any of you think of how we would use age, sex, nationality, or other demographic data in our analysis?   Perhaps you will want to ask for them to volunteer their email address so you can ask follow up questions -- if you really think you will email them to ask.
  3. You all need to come up with the user stories -- and write the participant instructions.   Remember, we have our testers for 60 minutes max for their activities and survey completion.   My brainstorm is "create your profile"  "participate in a discussion"  "post an image"  "start a discussion"  "add to a collaborative document"  "upload a document"   as candidate user stories.   You decide and you flesh out into more detail.
  4. So, then, what survey information will inform your team's design decisions?  And how will it inform each decision? 

 

You can access the MeetingSphere discussion from last week at http://us.meetingsphere.com/trial47451738/testing 

 

Status Report: Survey Form for Testers

I spent time last night viewing a tutorial, then putting together a simple survey form in Google Docs. This software is totally intuitive, reminds me of classic Visual Basic (simplified), and the variety of question constructs provided is sufficient to fill any potential requirement I've seen thus far.

 

RE: Demographic information from testers

>>Note that any question, regardless of format, can be flagged as "required" or not.

 

Name

Group category (selection -> WIU student / Conference Leader / Facilitator

Age?  (if used, suggest selection by range to make reporting easier:  18-24, 25-39, etc.)

E-mail for follow-up  {optional}

Rate your familiarity with {internet tools/web browsing/whatever...) -> selects value in range from Low to High: in this example w/b labelled "Little or No experience", "Very experienced" or something similar.

{Other suggestions welcome, but let's keep it to no more than 5 demographic points if possible}

..bc..

 

 

Reorganized Survey Content

 

Basic Questions

 

Agree / Disagree Questions

Rate your responses on a scale of 1-5 from Strongly Disagree to Strongly Agree. 

  1. The website was consistent.
  2. I found the website to be very complicated.
  3. The website was visually appealing.
  4. The terminology used throughout the website was clear.
  5. I would recommend this site for use at the ICA Conference. 
  6. I was able to find the theme information very easily.

 

Ease of Use Questions

Please rate the following questions on ease of use or difficulty of performing the tasks on a scale of 1-5, with 1 being Very Difficult and 5 being Very Easy. I'd also suggest including "N/A" as a possible choice (e.g.  N/A, 1, 2, 3, 4, 5 are valid responses). 

  1. How easy was it to create a user account/register to use the site?
  2. How easy was it to log into the site?
  3. Overall, how easy was it to use the site?
  4. How easy was it for you to navigate the website?
  5. How easily did you manage to find what you were looking for?

 

Open-ended questions 

  1. Do you have any ideas on how to improve the site? 
  2. Please describe what you liked about the site. 
  3. Please describe what you did not like about the site. 

 

 

 

Blogging/Posting Comments

Were you able to create a new post/blog?

      Yes      No

 

 

How easy was it to create a post/blog?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2              3                  4             5 

 

 

Did you experience any issues when creating a new post/blog?

Yes    No

(If yes, please describe.)

 

 

Were you able to view discussion comments posted by others?

Yes    No

(If no, please describe the reason why not.)

  

 

How easy was it to  comment on a post created by others?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

Did you experience any issues when commenting a new post/blog?

Yes    No

(If yes, please describe.)

 

Were you able to upload/attach a file?

Yes    No

(If  no, please describe.)

 

How easy was it to upload/attach a file?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2                3              4             5

 

Did you experience any issues uploading/attaching a file?

Yes    No

(If yes, please describe.)

 

Does  the site offer collaborative authoring such as wiki/discussion board/blog?

Yes    No

 

I liked using the collaborative tool available on this site.  

Strongly Disagree      Disagree      Neutral      Agree      Strongly Agree

            1                         2                        3              4                   5

 

Were you able to create a new document/spreadsheet/presentation?

Yes    No

(If  no, please describe.)

 

How easy was it to create a new document/spreadsheet/presentation?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2              3                4             5

 

Did you experience any issues creating new document/spreadsheet/presentation?

Yes    No

(If yes, please describe.)

 

Were  you able to edit a document/spreadsheet/presentation created by someone else?

Yes    No

(If yes, please describe.)

 

How easy was it to edit an existing document/spreadsheet/presentation?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2                3              4             5

 

Did you experience any issues editing an existing document/spreadsheet/presentation?

Yes    No

(If yes, please describe.)

 

How easy was it to track versions of a document/spreadsheet/presentation?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2                3              4             5

 

Does the blog section look professional?

Yes No

 

Is the real estate sufficient?

Yes No

If no, describe what you would change.

 

Was the blog’s tone and content relevant to the theme?

    Yes   No

 

At first glance, were you able to tell what the blog is about?

Yes    No

   

Were you able to 'Like' comments and blog posts?

Yes    No

(If yes, please describe.)

 

Were you able to 'Subscribe to' comments and blog posts? 

Yes    No

 

Describe collaborative authoring features which you like on this site. 

Yes   No

 

Describe other collaborating authoring features that would be useful if they were available  on this site.

Yes    No

 

Do you think that the site provides sufficient instructions for how to participate in online discussions?

Yes    No

 

Would you like having an option to send a private message to other group members participating in discussion? 

Yes    No

 

 

Uploading  (Video, Pictures/Image, Documents Repository) 

 

How difficult was is to download a video on a scale of 1-5?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

When selecting videos and then uploading one to any select theme (on the following three questions):

 

1. How difficult was it to find the video on scale of 1-5? 

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

2. How would you rank the quality of the video on a scale of 1-5? 

Excellent       Good       Fair          Bad        Poor

       1               2           3              4             5

 

3. How difficult was it to upload a video on a scale of 1-5? 

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

Any Comments on the above three questions?  

 

 

Were you able to view an entire video stream without difficulties?  

     Yes     No

 

Would you like to have an option to share videos with other friends and colleagues that are not subscribed to Podio through YouTube, Google videos or any other video sharing software? 

     Yes     No

 

How easy was it to upload an image?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

How easy was it to download an image?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

How easy was it to find the photo galleries?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

How easy was it to navigate the photo galleries?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

How easily can you find/access your area of interest?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

Would you like to be able to upload photos live from a smartphone directly to your conference account? 

     Yes     No

 

Would you be interested in extracting files or photos to re-use them for personal use?

     Yes     No

 

How would you rate the design/visual appearance? (1 to 10 with 1 being the lowest and 10 being the highest)

 

 

How would your rate the font size?

Too big     Just right     Too small     

     

Any recommendations regarding the design?

 

Where you able to save video content?

     Yes     No

 

How easy was it to upload a document?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

How easy was it to download a document?

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

Did you encounter any problems uploading any file formats and/or file sizes?

     Yes     No

 

Were you able to download and open all file formats available on the site?

     Yes     No

 

As a non-admin user, were you able to delete files you uploaded?

     Yes     No

 

As a non-admin user, were you able to delete files you did NOT upload?

     Yes     No

 

As an admin user, were you able to delete all uploaded files?

     Yes     No

 

How easy was it to find the document repository(ies)? 

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

When uploading a word document to any theme folder (for the following two questions):

 

1. How difficult was it to find where the folder was?

Very difficult     Difficult    Neutral     Easy     Very Easy

        1                 2           3              4             5

 

2. How difficult was it to upload the document?

Very difficult     Difficult    Neutral     Easy     Very Easy

         1                 2           3              4             5

 

How easily can you find ways to post files or documents? 

Very difficult     Difficult    Neutral     Easy     Very Easy

            1                 2           3              4             5

 

What type of files are you interested in posting/uploading? 

         a) PDF      b) PPT      c) Video      d) Photos      e) Microsoft Office files      f) Audio files 

 

Would you be interested in posting files yourself or simply viewing pre-published and accessible files?

 

 

What types of files did you upload (please check all that apply):

      Video

      Audio

      Image

      PDF

      Microsoft Word document

      Microsoft Excel spreadsheet

      Microsoft PowerPoint presentation  

      None

      Other - Please list:

If you experienced any issues uploading files, please explain: 

 

 

What types of files did you view (please check all that apply):

      Video

      Audio

      Image

      PDF

      Microsoft Word document

      Microsoft Excel spreadsheet

      Microsoft PowerPoint presentation  

      Other - Please list:

If you experienced any issues viewing files, please explain: 

 

What types of files did you edit (please check all that apply):

      Microsoft Word document

      Microsoft Excel spreadsheet

      Microsoft PowerPoint presentation  

      Other - Please list:

If you experienced any issues editing files, please explain: 

 

 

How easy was the document repository to utilize?

Very difficult     Difficult    Neutral     Easy     Very Easy

           1                 2           3              4             5

 

Where you able to save documents? 

     Yes     No

 

How long did it take to upload content to the page?

 

Do you think that the site provides sufficient instructions for how to upload content? 

Absolutely    Yes       Neither      No       Not at all

    1                2             3           4             5

 

If you found that instructions were not sufficient, do you have suggestion for how to make it clearer?

 

 

If you had issues while uploading a file or could not find the appropriate feature? Please explain.  

 


Was it easy to upload a document, locate this option, was the action intuitive, did you need to use the guide/help button? Please explain.

 

 

How would you rate navigability? (1 to 10 with 1 being lowest and 10 being the highest)

 

 

How would you rate the usability? (1 to 10 with 1 being lowest and 10 being highest)

 

 

If applicable, were you able to understand how to use app's with minimal guidance, please answer with the name of the app?

     Yes     No     N/A

 

Demographics

 

Specify the product you are reviewing:

  • Google+
  • Joomla
  • Huddle
  • Ning
  • Podio
  • Wiggio   

 

Specify your testing group:

  • WIU Student
  • Conference Leader/Facilitator
  • Other - Please list:

 

What is your age group:

  • 20 and under
  • 20-35
  • 36-45
  • 46-55
  • 56-60
  • 60 and above   

 

What is your nationality?

  • Please specify your origin_____________________

 

What group best describes you*:

*select all that apply

  • Student (in-class)
  • Student (online)
  • Teacher/Professor
  • Professional
      • specify your profession:__________________
  • Business Owner/ Entrepreneur
      • specify your industry:_____________________________
  • Retired
  • Other - Please list:

 

Are you directly involved with the ICA group?

  • Yes*
  • No
  • I would like to be

 

*If yes, please specify your role______________________________________________

 

What is the highest level of education you have completed?

  • Less than high-school
  • High School
  • 2-year college degree
  • 4-year college degree
  • Master’s Degree
  • Doctoral Degree
  • Other

 

What is your technical skill level?  

  • Beginner
  • Intermediate
  • Advance
  • Professional (I work in IT/IS)

 

How much time browsing the Internet do you spend per day?

  • Use it daily, both for work and personal use
  • Only use it for work
  • Only use it for personally use
  • Hardly ever, only when I have to
  • I don't know how to browse the Internet

 

 

Are you using wireless or Ethernet connection?

  • Wireless
  • Ethernet (wired)

 

What type of internet connection are you using?

  • 33.6 or less
  • 56K
  • Cable/ISDN
  • DSL
  • T1
  • Don't know
  • Other - Please list:

 

Did you have any connection problems?

  • Yes*
      • Were the issues related to your device?  Yes_____   No_____
      • Were the issues related to your Internet connection?  Yes______   No_____
      • Were the issues related to the product you are testing?   Yes_______  No_____
  • No

 

What browser type did you use?

  • Google Chrome (any version)
  • Mozilla Firefox  (greater than v4.0)
  • Mozilla Firefox  (less than v4.0)
  • Internet Explorer 10
  • Internet Explorer 9
  • Internet Explorer 8
  • Internet Explorer 7
  • Safari
  • Opera
  • Other - Please list:
  • Don't know

 

What device did you use to test this product?

  • Desktop computer
      • Specify make/model_________
      • Don't know
  • Laptop computer
      •     Specify make/model_________
      • Don't know
  • Tablet
      • Specify make/model_________
      • Don't know
  • Mobile device
      • Specify make/model_________
      • Don't know
  • Video game console
      • Specify make/model_________
      • Don't know

 

What operating system are you using?

  • Windows 7
  • Windows Vista
  • Windows XP
  • Mac OS X v10.6 (Snow Leopard)
  • Mac OS X v10.7 (Lion)
  • Mac OS X v10.8 (Mountain Lion)
  • Linux
  • Unix
  • Other - Please list:
  • Don't know

 

What is your familiarity level with this specific product?  

  • First time user   
  • I used it once or twice  
  • I am familiar with the product to some extent  
  • I use this product often, if so is it for  personal or professional use?

 

Are you familiar with other virtual / cloud / web-based tools?

  • Yes
      • Please specify what tools/products do you often use_____________________________
  • No

 

The work I do in my organization requires technical knowledge related to using Internet on a daily basis?

  • Strongly Agree
  • Agree
  • Neutral
  • Disagree
  • Strongly Disagree

 

I use virtual tools (cloud, web-based) in my organization/school/work/personal life on a daily basis?

  • Strongly Agree
  • Agree
  • Neutral
  • Disagree
  • Strongly Disagree

 

I use virtual tools (cloud, web-based) mostly for the following reasons*:

*select all that apply 

  • Document sharing/repository
  • Communication (email, IM, video conference)
  • Collaboration
  • Image/video sharing
  • Blogging, discussions, forums

 

In an average week how often do you use sites that involve membership and interacting with groups?

Never

  • 1 time a week
  • 2-3 times a week
  • 4-5 times a week
  • More than 5 times a week

 

Do you use social media*? Please select the answer that best describes you:

*Facebook, Twitter, YouTube, Flickr, etc.

  • Yes, I have multiple accounts and use/post daily
  • Yes - I use it and have active accounts and use it occasionally
  • I have an account, but don't use it
  • I do not have an account, but use some of the tools occasionally
  • No - I don't have an account nor do I use any of these tools

 

Which mobile device did you use:

  • I did not use mobile device
  • Apple iPhone
  • Apple iPad
  • BlackBerry
  • Android Smartphone
  • Other - Please list:

 

Do you use your mobile device to access web-based applications:

  • Yes, use it daily for email, social media, web-browsing and more
  • No, I only use my mobile device to calls

 

Would you actively use a mobile application to access this product that you are testing:

  • Yes, it is the only way that I would use it and be able to join the conference
  • No, I prefer to access the conference via my computer
  • No, my mobile device does not support applications
  • No, the product that I am reviewing does not support my mobile device (no application available)

 

What type of group* did you create?

*if applicable to your product

  •        Education
  •        Professional
  •        Recreational
  •        Other - Please list:

 

Comments (11)

Regina said

at 3:27 pm on Mar 7, 2012

Thanks Dan Mo!

Tina Piotrowski said

at 6:42 pm on Feb 21, 2012

hey team one and team 8 how did you set up a link to another page? I am having some trouble figuring it out

Basharat said

at 3:35 pm on Feb 19, 2012

Group 8 Representative
email: blaghari@gmail.com / blvt440@gmail.com
skype: blvt440

WCORSE@WISMAIL.NET said

at 11:19 am on Feb 19, 2012

Bill Corse Skye name is "william.corse"!!

Dan Mo said

at 11:01 am on Feb 19, 2012

My email address is missing from the list above, please add: dmoral522@gmail.com

marcelina.now said

at 3:07 pm on Feb 16, 2012

Marcelina (poormrcat - skype name)

Danny Mittleman said

at 1:56 pm on Feb 15, 2012

wcorse@mismail.net team 3

Erica O'Neil said

at 12:45 pm on Feb 15, 2012

Group 7 Representative
Erica O'Neil
email: ericaloneil@gmail.com

Danny Mittleman said

at 11:20 am on Feb 15, 2012

Barry bjd70gt@yahoo.com

Danny Mittleman said

at 11:14 am on Feb 15, 2012

Barry Deron will represent team 2

hsouare@... said

at 12:13 am on Feb 15, 2012

my name is eric souare
email : hsouare@gmail.com
skype : cocody7

You don't have permission to comment on this page.