|
Parameter |
Definition |
Scoring |
Wgt |
Medical Objects |
|
Capability for reliable and secure data transmission |
|
Message tracing
|
Ability for user to trace messages to final recipient |
none = 0
partial = 5
full = 10 |
3 |
8 |
24 |
|
Functionality verification |
Ability for user to verify system functionality/operating status |
none = 0
partial = 5
full = 10 |
2 |
7 |
14 |
|
Error Alerts |
Alert to the user that system is not functioning |
none = 0
manual = 5
imm/auto = 10 |
3 |
7 |
21 |
|
Infrastructure |
Robustness and reliability of the communications infrastructure |
low = 0
medium = 5
high = 10 |
1 |
9 |
9 |
|
NPP1-NPP11
Compliance |
Meets the 10 national Privacy Principles as per the Privacy act 1998 |
none = 0
all = 10 |
3 |
9 |
27 |
|
|
|
|
Total
|
105 |
|
|
|
Compliance with Australian and International Messaging Standards |
|
HL7 V2.x
Compliance |
Ability to comply with HL7 V2.3.1, V2.4, V2.5 |
none = 0
some = 5
all = 10 |
2 |
7 |
14 |
|
AS4700 support |
Ability to comply with the current versions of AS4700.x and HB262 |
none = 0
some = 5
all = 10 |
3 |
8 |
24 |
|
Msg validation |
Are the HL7 messages validated? |
no = 0
partial = 5
full = 10 |
2 |
8 |
16 |
|
Other Standards |
Does the product comply with any other standards: HTTP, SMTP, sMIME... |
none = 0
some = 5
all = 10 |
2 |
7 |
14 |
|
Product certification |
Has the product/service been certified? |
no = 0
some = 5
full - 10 |
2 |
0 |
0 |
|
|
|
|
Total |
68 |
| |
|
Robustness of system concept and design |
|
Network type used |
Standard internet or custom network (VPN) |
fully custom = 0
mixed = 5
fully std = 10 |
2 |
10 |
20 |
|
Programming languages used |
Were standard languages, modules and libraries used? |
fully custom = 0
mixed = 5
fully Std = 10 |
2 |
5 |
10 |
|
Concept/Design Robustness |
Overall robustness and reliability of the infrastructure |
low = 0
medium = 5
high = 10 |
1 |
7 |
7 |
|
Design Methodology |
Is the design methodology formal and structured or ad-hoc? |
ad hoc = 0
medium = 5
formal = 10 |
2 |
5 |
10 |
|
|
|
|
Total |
47 |
|
|
|
Known Implementation issues |
|
Issues reported by Vendor |
Assessment of relevance of problems reported by vendor. |
severe = 0
none = 10 |
2 |
3 |
6 |
|
Issues reported by users |
Assessment of relevance of problems reported by users |
severe = 0
none = 10 |
3 |
5 |
15 |
|
Product release maturity |
Number of releases in products life |
beta = 0
V1.0 = 1
10th or later = 10 |
1 |
3 |
3 |
|
|
|
|
Total |
24 |
|
|
|
Licensing and other user costs and/or intellectual property issues |
|
Cost per user |
The annual cost per average site with 3.5 doctors exchanging an avg #
messages per month |
High = 0
med = 5
no Cost -= 10 |
3 |
6 |
18 |
|
Software accessibility |
Proprietary, software in escrow or "Free & Open Source Software" |
prop = 0
in escrow = 5
FOSS |
2 |
2 |
4 |
|
Software ownership |
Who owns the intellectual property ("IP") of the software |
vender = 0
part = 5
p domain = 10 |
2 |
1 |
2 |
|
Who funds s/w development |
Who pays for the software development and maintenance? |
gov = 0
mixed = 5
industry = 10 |
2 |
10 |
20 |
|
|
|
|
Total |
44 |
|
|
|
depth, scope and cost of training and education required |
|
Setup education - time |
The amount of time required for a user to learn setup the system |
high = 0
medium = 5
nil = 10 |
1 |
8 |
8 |
|
Setup education - cost |
The cost of education of a user to learn to setup the system |
high = 0
medium = 5
nil = 0 |
1 |
7 |
7 |
|
Operation education - time |
The amount of time required for user to learn to operate the system |
high = 0
medium = 5
nil = 0 |
3 |
7 |
21 |
|
Operation education - cost |
|
high = 0
medium = 5
nil = 0 |
3 |
6 |
18 |
|
Dummy msg Source |
|
none = 0
medium = 5
comp = 10 |
1 |
5 |
5 |
|
|
|
|
Total |
59 |
|
|
|
Effect on GP/Practice Workflow |
|
Effect on GP workflow |
|
strong = 0
medium = 5
none = 10 |
3 |
6 |
18 |
|
Decrease/Increase of GP workload |
|
increase = 0
same = 5
decrease = 10 |
2 |
5 |
10 |
|
Effect on practice/admin workflow |
|
strong = 0
medium = 5
none = 10 |
2 |
6 |
12 |
|
Decrease/Increase of admin workload |
|
increase = 0
same = 5
decrease = 10 |
2 |
5 |
10 |
|
Recovery from total system failure |
|
>24 hours = 0
>4 hours = 5
immediate = 10 |
3 |
6 |
18 |
|
|
|
|
Total |
68 |
|
|
|
Total Criteria i (Reliability and Security)
Total Criteria ii(Standards compliance)
Total Criteria ii(Robustness)
Total Criteria iv(Implementation issues)
Total Criteria v(Licensing costs & IP)
Total Criteria vi(Training and Education)
Total Criteria vii(Effect on GP/Practice Workflow)
|
105
68
47
24
44
59
68
|
|
Grand Total |
415
|
