159 participants responded to the CSAT survey after 1/22 All-Adobe
Express mobile Beta testing event.
Section 2. Average Ratings on Core Criteria
The following tables (Table 7 ~ 10) shows the average ratings on core
criteria.
Our core criteria includes
- Overall satisfaction
- Performance
- Stability
- Ease of use (Easy)
- Capabilities meeting needs (Needs)
- Look & Aesthetics (Look)
Table 7. Average ratings on core criteria for all
participants
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
159
|
3.66
|
1.10
|
4
|
3.74
|
1.48
|
1
|
5
|
4
|
-0.63
|
-0.54
|
0.09
|
|
Performance*
|
2
|
159
|
3.68
|
1.27
|
4
|
3.80
|
1.48
|
1
|
5
|
4
|
-0.57
|
-0.86
|
0.10
|
|
Stability*
|
3
|
159
|
3.96
|
1.26
|
4
|
4.16
|
1.48
|
1
|
5
|
4
|
-0.98
|
-0.18
|
0.10
|
|
Easy*
|
4
|
159
|
3.36
|
1.19
|
4
|
3.43
|
1.48
|
1
|
5
|
4
|
-0.48
|
-0.88
|
0.09
|
|
Needs*
|
5
|
159
|
3.76
|
1.18
|
4
|
3.88
|
1.48
|
1
|
5
|
4
|
-0.64
|
-0.59
|
0.09
|
|
Look*
|
6
|
159
|
3.91
|
1.06
|
4
|
4.05
|
1.48
|
1
|
5
|
4
|
-0.91
|
0.32
|
0.08
|
Table 8. Average ratings on core criteria by Platform (mApp
vs. mWeb)
App users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
103
|
3.68
|
1.09
|
4
|
3.76
|
1.48
|
1
|
5
|
4
|
-0.66
|
-0.47
|
0.11
|
|
Performance*
|
2
|
103
|
3.71
|
1.30
|
4
|
3.84
|
1.48
|
1
|
5
|
4
|
-0.63
|
-0.85
|
0.13
|
|
Stability*
|
3
|
103
|
4.11
|
1.19
|
5
|
4.31
|
0.00
|
1
|
5
|
4
|
-1.11
|
0.17
|
0.12
|
|
Easy*
|
4
|
103
|
3.26
|
1.19
|
4
|
3.30
|
1.48
|
1
|
5
|
4
|
-0.34
|
-1.03
|
0.12
|
|
Needs*
|
5
|
103
|
3.71
|
1.13
|
4
|
3.80
|
1.48
|
1
|
5
|
4
|
-0.54
|
-0.73
|
0.11
|
|
Look*
|
6
|
103
|
3.88
|
1.06
|
4
|
4.02
|
1.48
|
1
|
5
|
4
|
-0.89
|
0.29
|
0.10
|
Web users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
56
|
3.62
|
1.14
|
4
|
3.70
|
1.48
|
1
|
5
|
4
|
-0.56
|
-0.73
|
0.15
|
|
Performance*
|
2
|
56
|
3.62
|
1.23
|
4
|
3.72
|
1.48
|
1
|
5
|
4
|
-0.43
|
-0.93
|
0.16
|
|
Stability*
|
3
|
56
|
3.70
|
1.36
|
4
|
3.85
|
1.48
|
1
|
5
|
4
|
-0.73
|
-0.76
|
0.18
|
|
Easy*
|
4
|
56
|
3.55
|
1.17
|
4
|
3.65
|
0.74
|
1
|
5
|
4
|
-0.75
|
-0.48
|
0.16
|
|
Needs*
|
5
|
56
|
3.86
|
1.26
|
4
|
4.02
|
1.48
|
1
|
5
|
4
|
-0.82
|
-0.41
|
0.17
|
|
Look*
|
6
|
56
|
3.96
|
1.06
|
4
|
4.11
|
1.48
|
1
|
5
|
4
|
-0.92
|
0.28
|
0.14
|
Table 9. Average ratings on core criteria by OS
Android users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
32
|
3.84
|
1.19
|
4
|
3.96
|
1.48
|
1
|
5
|
4
|
-0.70
|
-0.75
|
0.21
|
|
Performance*
|
2
|
32
|
4.00
|
1.16
|
4
|
4.15
|
1.48
|
1
|
5
|
4
|
-0.83
|
-0.45
|
0.21
|
|
Stability*
|
3
|
32
|
4.44
|
1.01
|
5
|
4.65
|
0.00
|
1
|
5
|
4
|
-1.81
|
2.62
|
0.18
|
|
Easy*
|
4
|
32
|
3.34
|
1.18
|
4
|
3.38
|
1.48
|
1
|
5
|
4
|
-0.32
|
-1.02
|
0.21
|
|
Needs*
|
5
|
32
|
3.88
|
1.18
|
4
|
4.00
|
1.48
|
1
|
5
|
4
|
-0.67
|
-0.74
|
0.21
|
|
Look*
|
6
|
32
|
4.09
|
1.03
|
4
|
4.23
|
1.48
|
2
|
5
|
3
|
-0.70
|
-0.86
|
0.18
|
iOS users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
127
|
3.61
|
1.08
|
4
|
3.68
|
1.48
|
1
|
5
|
4
|
-0.63
|
-0.49
|
0.10
|
|
Performance*
|
2
|
127
|
3.60
|
1.29
|
4
|
3.71
|
1.48
|
1
|
5
|
4
|
-0.49
|
-0.96
|
0.11
|
|
Stability*
|
3
|
127
|
3.84
|
1.29
|
4
|
4.02
|
1.48
|
1
|
5
|
4
|
-0.82
|
-0.49
|
0.11
|
|
Easy*
|
4
|
127
|
3.37
|
1.19
|
4
|
3.44
|
1.48
|
1
|
5
|
4
|
-0.51
|
-0.88
|
0.11
|
|
Needs*
|
5
|
127
|
3.73
|
1.18
|
4
|
3.84
|
1.48
|
1
|
5
|
4
|
-0.63
|
-0.58
|
0.10
|
|
Look*
|
6
|
127
|
3.87
|
1.06
|
4
|
4.01
|
1.48
|
1
|
5
|
4
|
-0.95
|
0.48
|
0.09
|
Table 10. Average ratings on core criteria by OS x
Platform
mApp Android users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
22
|
4.18
|
0.96
|
4
|
4.33
|
1.48
|
2
|
5
|
3
|
-0.96
|
-0.10
|
0.20
|
|
Performance*
|
2
|
22
|
4.14
|
1.21
|
5
|
4.33
|
0.00
|
1
|
5
|
4
|
-1.18
|
0.18
|
0.26
|
|
Stability*
|
3
|
22
|
4.41
|
1.14
|
5
|
4.67
|
0.00
|
1
|
5
|
4
|
-1.72
|
1.80
|
0.24
|
|
Easy*
|
4
|
22
|
3.59
|
1.05
|
4
|
3.61
|
1.48
|
2
|
5
|
3
|
-0.11
|
-1.29
|
0.22
|
|
Needs*
|
5
|
22
|
4.09
|
1.06
|
4
|
4.22
|
1.48
|
2
|
5
|
3
|
-0.85
|
-0.63
|
0.23
|
|
Look*
|
6
|
22
|
4.45
|
0.80
|
5
|
4.61
|
0.00
|
2
|
5
|
3
|
-1.45
|
1.68
|
0.17
|
mApp iOS users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
81
|
3.54
|
1.08
|
4
|
3.60
|
1.48
|
1
|
5
|
4
|
-0.60
|
-0.57
|
0.12
|
|
Performance*
|
2
|
81
|
3.59
|
1.30
|
4
|
3.71
|
1.48
|
1
|
5
|
4
|
-0.50
|
-1.00
|
0.14
|
|
Stability*
|
3
|
81
|
4.02
|
1.19
|
5
|
4.22
|
0.00
|
1
|
5
|
4
|
-0.96
|
-0.11
|
0.13
|
|
Easy*
|
4
|
81
|
3.17
|
1.21
|
4
|
3.22
|
1.48
|
1
|
5
|
4
|
-0.33
|
-1.15
|
0.13
|
|
Needs*
|
5
|
81
|
3.60
|
1.14
|
4
|
3.68
|
1.48
|
1
|
5
|
4
|
-0.46
|
-0.76
|
0.13
|
|
Look*
|
6
|
81
|
3.73
|
1.07
|
4
|
3.85
|
1.48
|
1
|
5
|
4
|
-0.77
|
0.10
|
0.12
|
mWeb Android users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
10
|
3.1
|
1.37
|
3.0
|
3.12
|
1.48
|
1
|
5
|
4
|
0.07
|
-1.55
|
0.43
|
|
Performance*
|
2
|
10
|
3.7
|
1.06
|
3.5
|
3.75
|
0.74
|
2
|
5
|
3
|
0.03
|
-1.58
|
0.33
|
|
Stability*
|
3
|
10
|
4.5
|
0.71
|
5.0
|
4.62
|
0.00
|
3
|
5
|
2
|
-0.85
|
-0.75
|
0.22
|
|
Easy*
|
4
|
10
|
2.8
|
1.32
|
3.0
|
2.88
|
1.48
|
1
|
4
|
3
|
-0.20
|
-1.92
|
0.42
|
|
Needs*
|
5
|
10
|
3.4
|
1.35
|
3.0
|
3.50
|
1.48
|
1
|
5
|
4
|
-0.18
|
-1.29
|
0.43
|
|
Look*
|
6
|
10
|
3.3
|
1.06
|
3.0
|
3.25
|
0.74
|
2
|
5
|
3
|
0.47
|
-1.20
|
0.33
|
mWeb iOS users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
46
|
3.74
|
1.06
|
4
|
3.82
|
1.48
|
1
|
5
|
4
|
-0.68
|
-0.45
|
0.16
|
|
Performance*
|
2
|
46
|
3.61
|
1.27
|
4
|
3.71
|
1.48
|
1
|
5
|
4
|
-0.46
|
-0.98
|
0.19
|
|
Stability*
|
3
|
46
|
3.52
|
1.41
|
4
|
3.63
|
1.48
|
1
|
5
|
4
|
-0.53
|
-1.09
|
0.21
|
|
Easy*
|
4
|
46
|
3.72
|
1.09
|
4
|
3.82
|
0.74
|
1
|
5
|
4
|
-0.86
|
-0.06
|
0.16
|
|
Needs*
|
5
|
46
|
3.96
|
1.23
|
4
|
4.13
|
1.48
|
1
|
5
|
4
|
-0.97
|
-0.09
|
0.18
|
|
Look*
|
6
|
46
|
4.11
|
1.02
|
4
|
4.26
|
1.48
|
1
|
5
|
4
|
-1.33
|
1.64
|
0.15
|
Table 11. Average ratings on core criteria by Browser
type
Chrome users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
24
|
3.54
|
1.25
|
4.0
|
3.65
|
1.48
|
1
|
5
|
4
|
-0.54
|
-0.81
|
0.26
|
|
Performance*
|
2
|
24
|
3.83
|
1.24
|
4.0
|
3.95
|
1.48
|
1
|
5
|
4
|
-0.49
|
-1.04
|
0.25
|
|
Stability*
|
3
|
24
|
4.08
|
1.25
|
4.5
|
4.30
|
0.74
|
1
|
5
|
4
|
-1.31
|
0.62
|
0.25
|
|
Easy*
|
4
|
24
|
3.54
|
1.32
|
4.0
|
3.65
|
0.74
|
1
|
5
|
4
|
-0.80
|
-0.72
|
0.27
|
|
Needs*
|
5
|
24
|
3.96
|
1.33
|
5.0
|
4.15
|
0.00
|
1
|
5
|
4
|
-0.87
|
-0.53
|
0.27
|
|
Look*
|
6
|
24
|
3.96
|
0.95
|
4.0
|
4.05
|
1.48
|
2
|
5
|
3
|
-0.50
|
-0.84
|
0.19
|
Safari users
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
32
|
3.69
|
1.06
|
4
|
3.73
|
1.48
|
2
|
5
|
3
|
-0.48
|
-1.07
|
0.19
|
|
Performance*
|
2
|
32
|
3.47
|
1.22
|
4
|
3.54
|
1.48
|
1
|
5
|
4
|
-0.40
|
-0.98
|
0.22
|
|
Stability*
|
3
|
32
|
3.41
|
1.39
|
4
|
3.50
|
1.48
|
1
|
5
|
4
|
-0.37
|
-1.21
|
0.25
|
|
Easy*
|
4
|
32
|
3.56
|
1.08
|
4
|
3.62
|
0.74
|
1
|
5
|
4
|
-0.61
|
-0.64
|
0.19
|
|
Needs*
|
5
|
32
|
3.78
|
1.21
|
4
|
3.92
|
1.48
|
1
|
5
|
4
|
-0.75
|
-0.44
|
0.21
|
|
Look*
|
6
|
32
|
3.97
|
1.15
|
4
|
4.15
|
1.48
|
1
|
5
|
4
|
-1.05
|
0.41
|
0.20
|
Section 3. Trends
Comparing two all-Adobe testing events
There were two all-Adobe testing events (1/4/24 and 1/22/24). Here,
we do a quick analysis of how the participants’ ratings changed during
that period.
We do not see a marked shifts in our tester’s evaluation of the app
in terms of overall satisfaction, performance, stability, and
needs. We do, however, do see a significant decrease in
ease of use and look.
Why might we see such decrease in ease of use ratings? 1. Different
user task (more video editing involved) 2. Design changes 3. Past
experiences
Ratings for all participants
2024-01-04
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
308
|
3.80
|
1.17
|
4
|
3.94
|
1.48
|
1
|
5
|
4
|
-0.90
|
-0.05
|
0.07
|
|
Performance*
|
2
|
305
|
3.67
|
1.41
|
4
|
3.83
|
1.48
|
1
|
5
|
4
|
-0.65
|
-1.01
|
0.08
|
|
Stability*
|
3
|
305
|
3.97
|
1.38
|
5
|
4.19
|
0.00
|
1
|
5
|
4
|
-1.00
|
-0.48
|
0.08
|
|
Easy*
|
4
|
308
|
3.69
|
1.12
|
4
|
3.79
|
1.48
|
1
|
5
|
4
|
-0.75
|
-0.32
|
0.06
|
|
Needs*
|
5
|
307
|
3.84
|
1.20
|
4
|
3.99
|
1.48
|
1
|
5
|
4
|
-0.79
|
-0.44
|
0.07
|
|
Look*
|
6
|
307
|
4.35
|
0.93
|
5
|
4.53
|
0.00
|
1
|
5
|
4
|
-1.52
|
1.80
|
0.05
|
2024-01-22
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
159
|
3.66
|
1.10
|
4
|
3.74
|
1.48
|
1
|
5
|
4
|
-0.63
|
-0.54
|
0.09
|
|
Performance*
|
2
|
159
|
3.68
|
1.27
|
4
|
3.80
|
1.48
|
1
|
5
|
4
|
-0.57
|
-0.86
|
0.10
|
|
Stability*
|
3
|
159
|
3.96
|
1.26
|
4
|
4.16
|
1.48
|
1
|
5
|
4
|
-0.98
|
-0.18
|
0.10
|
|
Easy*
|
4
|
159
|
3.36
|
1.19
|
4
|
3.43
|
1.48
|
1
|
5
|
4
|
-0.48
|
-0.88
|
0.09
|
|
Needs*
|
5
|
159
|
3.76
|
1.18
|
4
|
3.88
|
1.48
|
1
|
5
|
4
|
-0.64
|
-0.59
|
0.09
|
|
Look*
|
6
|
159
|
3.91
|
1.06
|
4
|
4.05
|
1.48
|
1
|
5
|
4
|
-0.91
|
0.32
|
0.08
|

Ratings by OS across two testing events

Comparing mWeb events
There were 3 mWeb-specific events in the month of January. The team
identified major performance and stability issues related to mWeb
through Jan 9th event, and since then, we have seen steady improvements
on performance and stability ratings for mWeb. However, we do not meet
our minimum criteria yet for mWeb for most criteria (except
Needs and Look).
2024-01-09
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
72
|
2.94
|
1.29
|
3
|
2.93
|
1.48
|
1
|
5
|
4
|
0.06
|
-1.13
|
0.15
|
|
Performance*
|
2
|
69
|
2.71
|
1.46
|
2
|
2.65
|
1.48
|
1
|
5
|
4
|
0.31
|
-1.39
|
0.18
|
|
Stability*
|
3
|
69
|
2.90
|
1.55
|
3
|
2.88
|
2.97
|
1
|
5
|
4
|
0.14
|
-1.54
|
0.19
|
|
Easy*
|
4
|
70
|
2.97
|
1.26
|
3
|
2.96
|
1.48
|
1
|
5
|
4
|
-0.08
|
-1.24
|
0.15
|
|
Needs*
|
5
|
69
|
3.20
|
1.30
|
4
|
3.25
|
1.48
|
1
|
5
|
4
|
-0.29
|
-1.15
|
0.16
|
|
Look*
|
6
|
70
|
3.70
|
1.08
|
4
|
3.80
|
1.48
|
1
|
5
|
4
|
-0.55
|
-0.28
|
0.13
|
2024-01-17
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
65
|
3.62
|
1.23
|
4
|
3.68
|
1.48
|
1
|
5
|
4
|
-0.48
|
-1.16
|
0.15
|
|
Performance*
|
2
|
65
|
3.25
|
1.41
|
4
|
3.30
|
1.48
|
1
|
5
|
4
|
-0.27
|
-1.33
|
0.18
|
|
Stability*
|
3
|
65
|
3.63
|
1.44
|
4
|
3.77
|
1.48
|
1
|
5
|
4
|
-0.58
|
-1.18
|
0.18
|
|
Easy*
|
4
|
65
|
3.85
|
1.09
|
4
|
3.98
|
1.48
|
1
|
5
|
4
|
-1.04
|
0.37
|
0.14
|
|
Needs*
|
5
|
65
|
3.97
|
1.16
|
4
|
4.09
|
1.48
|
1
|
5
|
4
|
-0.77
|
-0.71
|
0.14
|
|
Look*
|
6
|
65
|
4.15
|
1.03
|
4
|
4.32
|
1.48
|
1
|
5
|
4
|
-1.14
|
0.42
|
0.13
|
2024-01-22
|
|
vars
|
n
|
mean
|
sd
|
median
|
trimmed
|
mad
|
min
|
max
|
range
|
skew
|
kurtosis
|
se
|
|
Overall*
|
1
|
56
|
3.62
|
1.14
|
4
|
3.70
|
1.48
|
1
|
5
|
4
|
-0.56
|
-0.73
|
0.15
|
|
Performance*
|
2
|
56
|
3.62
|
1.23
|
4
|
3.72
|
1.48
|
1
|
5
|
4
|
-0.43
|
-0.93
|
0.16
|
|
Stability*
|
3
|
56
|
3.70
|
1.36
|
4
|
3.85
|
1.48
|
1
|
5
|
4
|
-0.73
|
-0.76
|
0.18
|
|
Easy*
|
4
|
56
|
3.55
|
1.17
|
4
|
3.65
|
0.74
|
1
|
5
|
4
|
-0.75
|
-0.48
|
0.16
|
|
Needs*
|
5
|
56
|
3.86
|
1.26
|
4
|
4.02
|
1.48
|
1
|
5
|
4
|
-0.82
|
-0.41
|
0.17
|
|
Look*
|
6
|
56
|
3.96
|
1.06
|
4
|
4.11
|
1.48
|
1
|
5
|
4
|
-0.92
|
0.28
|
0.14
|

Appendix
January 22nd Testing Event
Frequency & Distribution of raw scores for all participants

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
5
|
3.14
|
|
Somewhat dissatisfied
|
27
|
16.98
|
|
Neutral
|
21
|
13.21
|
|
Somewhat satisfied
|
70
|
44.03
|
|
Satisfied
|
36
|
22.64
|
|
Total
|
159
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
10
|
6.29
|
|
Somewhat disagree
|
24
|
15.09
|
|
Neutral
|
29
|
18.24
|
|
Somewhat agree
|
40
|
25.16
|
|
Agree
|
56
|
35.22
|
|
Total
|
159
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
11
|
6.92
|
|
Somewhat disagree
|
12
|
7.55
|
|
Neutral
|
27
|
16.98
|
|
Somewhat agree
|
31
|
19.50
|
|
Agree
|
78
|
49.06
|
|
Total
|
159
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
12
|
7.55
|
|
Somewhat disagree
|
34
|
21.38
|
|
Neutral
|
20
|
12.58
|
|
Somewhat agree
|
70
|
44.03
|
|
Agree
|
23
|
14.47
|
|
Total
|
159
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
7
|
4.40
|
|
Somewhat disagree
|
20
|
12.58
|
|
Neutral
|
31
|
19.50
|
|
Somewhat agree
|
47
|
29.56
|
|
Agree
|
54
|
33.96
|
|
Total
|
159
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
6
|
3.77
|
|
Somewhat disagree
|
10
|
6.29
|
|
Neutral
|
30
|
18.87
|
|
Somewhat agree
|
59
|
37.11
|
|
Agree
|
54
|
33.96
|
|
Total
|
159
|
100.00
|
Frequency & Distrubution of raw scores by OS
Android

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
1
|
3.12
|
|
Somewhat dissatisfied
|
5
|
15.62
|
|
Neutral
|
4
|
12.50
|
|
Somewhat satisfied
|
10
|
31.25
|
|
Satisfied
|
12
|
37.50
|
|
Total
|
32
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
1
|
3.12
|
|
Somewhat disagree
|
3
|
9.38
|
|
Neutral
|
6
|
18.75
|
|
Somewhat agree
|
7
|
21.88
|
|
Agree
|
15
|
46.88
|
|
Total
|
32
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
1
|
3.12
|
|
Somewhat disagree
|
1
|
3.12
|
|
Neutral
|
3
|
9.38
|
|
Somewhat agree
|
5
|
15.62
|
|
Agree
|
22
|
68.75
|
|
Total
|
32
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
2
|
6.25
|
|
Somewhat disagree
|
7
|
21.88
|
|
Neutral
|
6
|
18.75
|
|
Somewhat agree
|
12
|
37.50
|
|
Agree
|
5
|
15.62
|
|
Total
|
32
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
1
|
3.12
|
|
Somewhat disagree
|
4
|
12.50
|
|
Neutral
|
6
|
18.75
|
|
Somewhat agree
|
8
|
25.00
|
|
Agree
|
13
|
40.62
|
|
Total
|
32
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
0
|
0.00
|
|
Somewhat disagree
|
3
|
9.38
|
|
Neutral
|
6
|
18.75
|
|
Somewhat agree
|
8
|
25.00
|
|
Agree
|
15
|
46.88
|
|
Total
|
32
|
100.00
|
iOS

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
4
|
3.15
|
|
Somewhat dissatisfied
|
22
|
17.32
|
|
Neutral
|
17
|
13.39
|
|
Somewhat satisfied
|
60
|
47.24
|
|
Satisfied
|
24
|
18.90
|
|
Total
|
127
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
9
|
7.09
|
|
Somewhat disagree
|
21
|
16.54
|
|
Neutral
|
23
|
18.11
|
|
Somewhat agree
|
33
|
25.98
|
|
Agree
|
41
|
32.28
|
|
Total
|
127
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
10
|
7.87
|
|
Somewhat disagree
|
11
|
8.66
|
|
Neutral
|
24
|
18.90
|
|
Somewhat agree
|
26
|
20.47
|
|
Agree
|
56
|
44.09
|
|
Total
|
127
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
10
|
7.87
|
|
Somewhat disagree
|
27
|
21.26
|
|
Neutral
|
14
|
11.02
|
|
Somewhat agree
|
58
|
45.67
|
|
Agree
|
18
|
14.17
|
|
Total
|
127
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
6
|
4.72
|
|
Somewhat disagree
|
16
|
12.60
|
|
Neutral
|
25
|
19.69
|
|
Somewhat agree
|
39
|
30.71
|
|
Agree
|
41
|
32.28
|
|
Total
|
127
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
6
|
4.72
|
|
Somewhat disagree
|
7
|
5.51
|
|
Neutral
|
24
|
18.90
|
|
Somewhat agree
|
51
|
40.16
|
|
Agree
|
39
|
30.71
|
|
Total
|
127
|
100.00
|
January 4th All-Adobe Testing Event
Frequency & Distribution of raw scores for all participants
## Warning: Removed 28 rows containing non-finite values (`stat_count()`).

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
19
|
6.17
|
|
Somewhat dissatisfied
|
31
|
10.06
|
|
Neutral
|
41
|
13.31
|
|
Somewhat satisfied
|
120
|
38.96
|
|
Satisfied
|
97
|
31.49
|
|
Total
|
335
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
32
|
10.49
|
|
Somewhat disagree
|
51
|
16.72
|
|
Neutral
|
25
|
8.20
|
|
Somewhat agree
|
76
|
24.92
|
|
Agree
|
121
|
39.67
|
|
Total
|
335
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
25
|
8.20
|
|
Somewhat disagree
|
40
|
13.11
|
|
Neutral
|
23
|
7.54
|
|
Somewhat agree
|
47
|
15.41
|
|
Agree
|
170
|
55.74
|
|
Total
|
335
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
13
|
4.22
|
|
Somewhat disagree
|
47
|
15.26
|
|
Neutral
|
35
|
11.36
|
|
Somewhat agree
|
140
|
45.45
|
|
Agree
|
73
|
23.70
|
|
Total
|
335
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
15
|
4.89
|
|
Somewhat disagree
|
37
|
12.05
|
|
Neutral
|
48
|
15.64
|
|
Somewhat agree
|
88
|
28.66
|
|
Agree
|
119
|
38.76
|
|
Total
|
335
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
4
|
1.30
|
|
Somewhat disagree
|
16
|
5.21
|
|
Neutral
|
26
|
8.47
|
|
Somewhat agree
|
83
|
27.04
|
|
Agree
|
178
|
57.98
|
|
Total
|
335
|
100.00
|
Frequency & Distrubution of raw scores by OS
Android
## Warning: Removed 10 rows containing non-finite values (`stat_count()`).

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
4
|
6.15
|
|
Somewhat dissatisfied
|
5
|
7.69
|
|
Neutral
|
5
|
7.69
|
|
Somewhat satisfied
|
23
|
35.38
|
|
Satisfied
|
28
|
43.08
|
|
Total
|
74
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
4
|
6.35
|
|
Somewhat disagree
|
10
|
15.87
|
|
Neutral
|
4
|
6.35
|
|
Somewhat agree
|
11
|
17.46
|
|
Agree
|
34
|
53.97
|
|
Total
|
74
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
2
|
3.17
|
|
Somewhat disagree
|
6
|
9.52
|
|
Neutral
|
3
|
4.76
|
|
Somewhat agree
|
9
|
14.29
|
|
Agree
|
43
|
68.25
|
|
Total
|
74
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
2
|
3.08
|
|
Somewhat disagree
|
10
|
15.38
|
|
Neutral
|
5
|
7.69
|
|
Somewhat agree
|
29
|
44.62
|
|
Agree
|
19
|
29.23
|
|
Total
|
74
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
2
|
3.12
|
|
Somewhat disagree
|
6
|
9.38
|
|
Neutral
|
11
|
17.19
|
|
Somewhat agree
|
17
|
26.56
|
|
Agree
|
28
|
43.75
|
|
Total
|
74
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
1
|
1.56
|
|
Somewhat disagree
|
3
|
4.69
|
|
Neutral
|
3
|
4.69
|
|
Somewhat agree
|
21
|
32.81
|
|
Agree
|
36
|
56.25
|
|
Total
|
74
|
100.00
|
iOS
## Warning: Removed 18 rows containing non-finite values (`stat_count()`).

Overall CSAT
|
|
Freq
|
% Valid
|
|
Dissatisfied
|
15
|
6.17
|
|
Somewhat dissatisfied
|
26
|
10.70
|
|
Neutral
|
36
|
14.81
|
|
Somewhat satisfied
|
97
|
39.92
|
|
Satisfied
|
69
|
28.40
|
|
Total
|
261
|
100.00
|
Performance ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
28
|
11.57
|
|
Somewhat disagree
|
41
|
16.94
|
|
Neutral
|
21
|
8.68
|
|
Somewhat agree
|
65
|
26.86
|
|
Agree
|
87
|
35.95
|
|
Total
|
261
|
100.00
|
Stability ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
23
|
9.50
|
|
Somewhat disagree
|
34
|
14.05
|
|
Neutral
|
20
|
8.26
|
|
Somewhat agree
|
38
|
15.70
|
|
Agree
|
127
|
52.48
|
|
Total
|
261
|
100.00
|
Ease of use ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
11
|
4.53
|
|
Somewhat disagree
|
37
|
15.23
|
|
Neutral
|
30
|
12.35
|
|
Somewhat agree
|
111
|
45.68
|
|
Agree
|
54
|
22.22
|
|
Total
|
261
|
100.00
|
Needs ratings
|
|
Freq
|
% Valid
|
|
Disagree
|
13
|
5.35
|
|
Somewhat disagree
|
31
|
12.76
|
|
Neutral
|
37
|
15.23
|
|
Somewhat agree
|
71
|
29.22
|
|
Agree
|
91
|
37.45
|
|
Total
|
261
|
100.00
|
Look & feel
|
|
Freq
|
% Valid
|
|
Disagree
|
3
|
1.23
|
|
Somewhat disagree
|
13
|
5.35
|
|
Neutral
|
23
|
9.47
|
|
Somewhat agree
|
62
|
25.51
|
|
Agree
|
142
|
58.44
|
|
Total
|
261
|
100.00
|
Correlation analayses
Correlation of key variables (Jan 4th event)
|
|
Overall_ratings
|
Performance_ratings
|
Stability_ratings
|
Easy_ratings
|
Needs_ratings
|
|
Overall_ratings
|
|
|
|
|
|
|
Performance_ratings
|
0.68***
|
|
|
|
|
|
Stability_ratings
|
0.55***
|
0.67***
|
|
|
|
|
Easy_ratings
|
0.74***
|
0.53***
|
0.37***
|
|
|
|
Needs_ratings
|
0.71***
|
0.52***
|
0.35***
|
0.65***
|
|
|
Look_ratings
|
0.52***
|
0.34***
|
0.29***
|
0.57***
|
0.43***
|
Correlation of key variables (Jan 22nd event)
|
|
Overall_ratings
|
Performance_ratings
|
Stability_ratings
|
Easy_ratings
|
Needs_ratings
|
|
Overall_ratings
|
|
|
|
|
|
|
Performance_ratings
|
0.51***
|
|
|
|
|
|
Stability_ratings
|
0.40***
|
0.62***
|
|
|
|
|
Easy_ratings
|
0.73***
|
0.38***
|
0.28***
|
|
|
|
Needs_ratings
|
0.74***
|
0.50***
|
0.33***
|
0.69***
|
|
|
Look_ratings
|
0.58***
|
0.47***
|
0.36***
|
0.54***
|
0.57***
|