Alpha Test Results

Existential

Desktop

15.4″ Macbook Pro (2880 x 1800)/Mac Sierra V10.12.4
Firefox Quantum 58.0.2 (64-bit)

    Chrome Version 64.0.3282.186
    Safari Version 10.1

26.5″ Dell Monitor (2560 x 1440)/Windows 7
    Firefox Quantum 57.0 (64-bit)
    Chrome Version 65.0.3325.162 (Official Build) (64-bit)
    Internet Explorer V 11.0.9600.18893
No significant differences in load times. Internet Explorer shows a purple border around the edge of the buttons featured in these homepage screenshots. This comes from the original parent theme colour scheme. I must include some code at the top of the CSS to fix this and ensure there is no border in the future.
Tablet

iPad Wi-Fi 9.7″ (2048×1536) iOS11

    Safari V604.1
Samsung Galaxy Tab S2 9.7″ (2048×1536) Android 7.0.0
    Chrome V65.0.3325.109
    Samsung Internet V6.4.10.5
Viewing my website on both iOS and Android tablet devices showed no compatibility issues. Although I was only able to view my website on Safari’s browser on the University iPad, being able to view it in Chrome and Samsung Internet browsers on the Samsung Galaxy Tab proved to me that there are no major red flags to be addressed.
Technical issues on the homepage include:
  • The parallax sections do not function correctly. Instead, they are static images split into sections.
  • Using Samsung Internet, there is an integrated back-to-top button which interferes with the back-to-top button featured on my website. As a potential improvement, I would run a script to detect the browser it is running on and remove the button if it detects Samsung Internet.
  • The associated charities slider works considerably lesser then on desktop. When manually dragged across, the motion is glitchy and does not roll along smoothly. I would like to add left and right buttons to help to view these logos easier.
Mobile
Samsung S7 7.0
    Samsung Internet V6.2.0.1.12
iPhone 7 iOS11.2.6
    Google Chrome (for mobile) V62.0.3202.84
    Safari V604.1
 There are no major differences in the visual design between mobile browsers. They provided the same technical glitches as on tablet devices.

Performance

I have conducted six different tests to test load times on 3 different pages. I have included the two Chrome presets (Slow 3G and Fast 3G), three presets from our internal Web Deployment Record taken from Ofcom.org.uk (average broadband, average 3g and average 4g) and the WiFi provided at our university. I have disabled the cache for each test.

Homepage

Chrome Slow 3G

Total load: 42.86s
DOMContentLoaded: 15.70s
Chrome Fast 3G
Total load: 12.20s
DOMContentLoaded: 4.88s
Average Broadband
Total load: 5.96s
DOMContentLoaded: 2.05s
Average 3G
Total load: 20.11s
DOMContentLoaded: 5.58s
Average 4G
Total load: 8.61s
DOMContentLoaded: 2.78s
NUA Wi-Fi
Total load: 953ms
DOMContentLoaded: 859ms
These test results were produced after an initial test where I realised my homepage was taking over a minute over Chrome’s Fast 3G preset. This test showed me that the top Vine.png was 3.1MB and Veggies.png was 4.5MB. To solve this, I exported them as JPG’s instead and brought the quality down to about 65%. This brought Vine.jpg down to 560KB and Veggies.jpg to 559KB. This brought load time down to just over 10 seconds on Chrome’s Fast 3G. This page contains 12 images in total.
Contact Us
Chrome Slow 3G
Total load: 48.19s
DOMContentLoaded: 22.85s
Chrome Fast 3G
Total load: 8.20s
DOMContentLoaded: 2.16s
Average Broadband
Total load: 4.20s
DOMContentLoaded: 1.07s
Average 3G
Total load: 15.10s
DOMContentLoaded: 2.20s
Average 4G
Total load: 6.35s
DOMContentLoaded: 1.25s
NUA Wi-Fi
Total load: 1.58s
DOMContentLoaded: 1.05s
I chose to include the Contact Us page because it features a Google Maps widget and the Contact Form 7 plug-in. There is a considerable difference between the load time on slow and fast 3G. The only large media file to load is the background image and on the slow 3G connection a 185KB image takes 13.80s to load. This image is featured on every page so, in turn, it will affect the load time of every page of the site, however, it only has a slight impact on slow 3G so I’m not too worried about this.
Events
Chrome Slow 3G
Total load: 35.44s
DOMContentLoaded: 10.46s
Chrome Fast 3G
Total load: 9.68s
DOMContentLoaded: 3.01s
Average Broadband
Total load: 5.30s
DOMContentLoaded: 1.95s
Average 3G
Total load: 16.97s
DOMContentLoaded: 3.99s
Average 4G
Total load: 7.28s
DOMContentLoaded: 2.15s
NUA Wi-Fi
Total load: 872ms
DOMContentLoaded: 801ms
The Events page includes a large big body of text and five small hyperlinked images at the bottom. The hyperlinked images took the longest to load on slow 3G and the longest was 24.93s. As per the Contact Us page analytics, I am not too worried about this because this is only on the slow 3G connection. Every other load time is perfectly acceptable.
In conclusion, the overall load time for the pages of my website is within the expected boundaries. The Contact Form 7 plug-in featured on the Contact Us page has not slowed down the load times of my website. My biggest issue was the high-quality images I downloaded from royalty-free sites. If I can ensure the images that I upload onto my website are kept around 500KB and sized adequately, I predict that load times will stay reasonable.

Behaviour

To test the behaviour of my website and see what my testers thought I asked them to generally browse around my site performing tasks at their leisure. In my last test, I asked my testers to complete a task in the user persona of Deborah. This time I wanted to try something different. The questions I asked were:
  • Were requested pages easy and intuitive to find?
  • Do you have any comments on the aesthetic design?
  • What do you think of the colour scheme? Do you think it suits the ethos of the charity?

I also asked them to look at the pages where I had included plug-ins. The plug-ins I had installed at the time were:

  • Contact Form
  • NextGen Gallery
  • Team Members
  • Business Hours Indicator

These are the test results:

Ameer

Whilst on a current page, were you able to find the next page you wanted to be on easy enough?
Compared to your last prototype, it’s definitely an improvement. It’s great that links are organised within appropriate categories, so you get bonus points and cookies for that.

Do you have any comments on the aesthetic design?
The aesthetic design is good and I’m happy with it, however, I have my own way of interpreting design so I won’t go into too much detail. There are only 1 or 2 minor design issues. The caterpillar-like buttons on the homepage parallaxes need a little more floating space and they will be fine. Personally, I would make the navigation bar white and the links green.

What do you think of the colour scheme? Do you think it suits the ethos of the charity?
The colour scheme isn’t a problem, and I do think it suits the charity.

Plugins:
Contact Form 7 – The main text box becomes buggy when inputting text when Grammarly is installed. (The test was performed on my laptop and I use Grammarly in my Firefox browser).
NextGEN Gallery – Good
Team Members – Good
Business Hours Indicator – Good

[collapse]
Jason

Whilst on a current page, were you able to find the next page you wanted to be on easy enough?
Generally yes, using the new menu with the drop-down links, it’s easy enough to find commonly-accessed pages but a lot of the pages have links to other pages which I don’t think are always in the menu system, meaning that sometimes I felt a bit ‘lost’ on the site – but the menu is always present so it’s easy to go back to home or another page.

Do you have any comments on the aesthetic design?
I love the leaf image on the homepage, the text is easy to read and the design is nice and fluid. It looks modern. There are a few pages that could do with more images or centre aligned elements, like the volunteer page and the literature page. Align text to the left and see how that looks. It could be easier to read compared to centre aligned.

What do you think of the colour scheme? Do you think it suits the ethos of the charity?
Overall, I feel that the sire manages to take colour inspiration from the previous/existing site that they have but it looks so much better! The colour fit the brand.

Plugins:
Contact Form 7 – Try a different one that can have more horizontal fields.
NextGEN Gallery – Include artist and piece names. Have a look and see if there is a slideshow plugin that can handle the aspect ratios more efficiently.
Team Members – Looks good but try to get the same amount of text for each team member so that the boxes are evenly spaced. Either that or add some line breaks to the ones with less information to force the boxes bigger.
Business Hours Indicator – Great feature. Quite unusual but maybe try a different font to the Courier CSS preset but try to keep the uniqueness.

[collapse]
Will

Whilst on a current page, were you able to find the next page you wanted to be on easy enough?
Yes, the pages were very easy to navigate and find what I wanted.

Do you have any comments on the aesthetic design?
Add a margin underneath the buttons in the parallax sections on the homepage. Keep the back-to-top button in a fixed place. Block quotes need to include their own quotes from the WordPress layout.

What do you think of the colour scheme? Do you think it suits the ethos of the charity?
Yes, the colours feel pure and earthy. It fits their goals extremely well, good job!

Plugins:
Contact Form 7 – E-mail messages went through to Naomi’s student e-mail address (which is the correct, assigned destination). Both messages sent from real and fake accounts come through as well but the user did click ‘Yes’ to Recaptcha. No Recaptcha on the Volunteer form.
NextGEN Gallery – Gallery is aligned left and makes the centre aligned title look out of place. The bottom image should be centralised if there are less and 4.
Team Members – Boxes should all be the same size.
Business Hours Indicator – Within the top parallax there should be an opening times button which links to a full menu of opening times. This could be integrated using a .toggle jQuery function.

[collapse]
James V R

Whilst on a current page, were you able to find the next page you wanted to be on easy enough?
Yes. Everything was easy enough to find and the only problem I encountered was with the donate button. The home button is also linked to a wrong version of the homepage.

Do you have any comments on the aesthetic design?
Parallax was a good choice. Display images, background image and overall theme are suitable. The typeface of the opening times on the top parallax looks out of place as it is completely different from the rest of the website. You need to make a decision about whether to left align or centre align text. Margin needs to be added to the bottom of the text box in the top parallax.

What do you think of the colour scheme? Do you think it suits the ethos of the charity?
Works well with the look and feel fo the whole website.

Plugins:
Contact Form 7 – E-mail was sent through to Naomi’s student e-mail address which ensures functionality.
NextGEN Gallery – The left aligned art gallery looks out of place with the centre aligned title.
Team Members – Add read-more option to expand the additional text.
Business Hours Indicator – Typeface of the notification element in the top parallax (and footer) should be the same as rest of the website.

[collapse]
Célestin

Whilst on a current page, were you able to find the next page you wanted to be on easy enough?
The navigation system is good. Information wasn’t presented in an easy-to-consume way.

Do you have any comments on the aesthetic design?
Include more images because there is a lot of text. The meaning of the website is unclear. Place a down button at the bottom of the top parallax section to show there is more.

What do you think of the colour scheme? Do you think it suits the ethos of the charity?
I think it is well adapted to an older user group.

Plugins:
Contact Form 7 – E-mail was sent and delivered to Naomi’s student e-mail address as predicted.
NextGEN Gallery – Good
Team Members – Visual design is nice. This is a good example of easy-to-consume information.
Business Hours Indicator – Good

[collapse]

Thematic Analysis

My alpha test has produced a lot of qualitative data, meaning that there is plenty of descriptive improvement suggestions, as opposed to quantitative data which would be mainly numerical. This has stemmed from the open-ended nature of the test and the type of questions I asked. For this reason, I will be using thematic analysis to pick apart my data set. Thematic analysis works by identifying any recurring patterns, or themes, in a set of data collected.

Theme 1: The green buttons featured in the parallax sections on the homepage need padding underneath.

I asked all of my testers to start on the homepage and to navigate their way around from there. A majority commented on the green caterpillar/leaf buttons featured in the ‘Welcome to The Greenhouse Trust’ and ‘The eARTh Project’ parallaxes.

They commented that the button looked out of place being so close to the bottom of the text box. As an improvement, the testers that commented this, suggested that I add padding to the bottom of the white text box. This will make it look more like a button and fit in with the box better. There are two ways in which I could go about resolving this:

Solution 1: Bring the button out of the box entirely so it is it’s own element.

Solution 2: Add extra padding to the bottom of the white box as suggested by my testers.

Theme 2: Centre or left aligned text?

Throughout my website, I left some text centre aligned and others left aligned. I wanted to see whether my testers preferred one or the other, but it just ended up construed as confusing. I had testers land on pages and instead of the desired comment “Ooh, this looks a lot better!”, I received a lot of “Oh, what? Why?”. Upon questioning them for their opinion, it came to light that the majority had no preference and just wanted it to be consistent. I will be left aligning all main bodies of text throughout my website whereas titles and subtitles will remain centre aligned.

Theme 3: NextGEN Gallery is left aligned but the page title (as per every page) is centre aligned.

Another alignment issue was detected when I asked the users to look through the various plug-ins I had installed. The NextGEN Gallery is featured on the ‘Art’ page and showcases a handful of artwork from local artists which is also featured, in real-life, in the gallery above the café shop floor. The online gallery is aligned to the left, whereas the title text is centre aligned. Unfortunately, I’m not sure if I can change the alignment of the gallery plug-in on the page and this might be a case of hacking into the HTML of the page (if I can find a plug-in which is capable of doing so). If this can’t be done, I may look into a nicer gallery plug-in with greater alignment capabilities.

Another potential improvement, that one of the testers mentioned, was to centre align the last image featured as they are displayed in rows of 4. Someone else mentioned this as well but quickly followed with the idea that it may look out of place in the middle. This confirms my opinion as personally, I am happy to keep the next image looking like it is the start of a next row. Compiled with the fact that only one tester mentioned this, it is not as pressing as other issues.

Theme 4: Team Members information boxes are all different sizes.

The plug-in I have installed to be featured on my ‘Meet The Team’ page includes an information box for each team member inclusive of an image, description and any links to external related pages (e.g. Twitter account). These boxes are resized to fit the amount of text in the description section. Due to me pulling the content straight from the original website, there are uneven amounts of text for each team member. This results in the boxes being different sizes and it makes the page look misaligned. There are two ways in which I could solve this problem:
  • I could edit the <div> class in HTML and assign the same CSS attributes which defines a fixed width and height. This could be applied to all the boxes.
  • To avoid hacking into the code and sticking with the plug-in rules, I could keep each description to a two sentence minimum. This could keep the boxes all the same height.

Theme 5: Centre align the Contact Form 7.

The contact form I currently have installed is a fixed width and automatically aligned to the left. Even when I select for the page to be ‘Full Width’ in the WordPress pages editor, it still sticks to the left. I agree with my testers’ comments when the majority of them said that this makes the whole page look messy. I am unsure as to whether I would be able to fix this using HTML and the easiest option may be just to find another contact form plug-in that scales better.

Theme 6: Choose a different typeface for the Business Hours Indicator plug-in.

Almost all of my testers said that they disliked the typeface I had used for the opening times indicator on the homepage. Honestly, this was disappointing because I used this in the hope it would look like an alarm clock and stand out from the rest of the page. Having said this, they did see the latter, therefore I had the right idea but the execution was poor. I will be looking to choose another typeface which differs from the rest of the homepage but not ‘Courier’.