Accuracy in NatHERS Assessments: Consistency, complexity and comparison

by | Aug 9, 2019 | NatHERS

Accuracy in NatHERS Assessments is something we all assume or take for granted.

In this post guest contributor Rebecca Robins from Efficiency Assessments asks ‘Do we need to start looking at the accuracy of the comparison rather than the accuracy of the assessment?’Have you ever thought how strange it is that in NatHERS, we work with quite complex software that is predominantly used for the simple task of demonstrating a basic compliant or not compliant result?

NatHERS software can potentially model very complex scenarios and is capable of being used for detailed and accurate analysis. This capability has lead to more and more features of the software being incorporated as a mandatory part of all assessments.  The inclusion of these features in all assessments should, in theory, increase the accuracy of rating results. However, the quality assurance issues identified by the AAO’s annually shows a decline in alignment with the outcomes expected, despite the requirement that all Assessors enter data in accordance with the NatHERS Technical Note which details the data entry requirements for each of these parts.

The question becomes, when we are using the software for compliance only, could requirements that access fewer parts of the software be mandated, leaving some of the items set to a default value?  Doing this could help make the input data more consistent and therefore, the output data a more accurate comparison.  Do we need to start looking at the accuracy of the comparison rather than the accuracy of the assessment?

The reality of the NatHERS rating is that it gives a result out of 10. Theoretically, this result is a comparative result that assumes that all the data input into all assessments is the same and therefore the outputs can be compared in an ‘apples with apples’ scenario  This is never going to be entirely true given that differences and variables are going to occur through professional judgement, individual interpretation and human error.

If some defaults were set to minimise data input inaccuracies, wouldn’t this also create a comparative setting? For example, these defaults may mean assessing all dwellings:

  • in a greenfield situation, taking away the effect of neighbouring buildings on shading and cross flow ventilation; or
  • With only default windows or constructions, reducing risk of errors being created when products or systems are used by Assessors without adequate  experience or research skills to create accurate products and use them appropriately.
  • with a certain percentage/ number and  type of ceiling penetrations, removing
    • a step often hard to adhere to when the assessment is done at planning stage such as in NSW
    • Or installation (illegally) occurring after inspection meaning that the rating doesn’t hold true.

The ‘inaccurate data’ that all Assessors would create could then be used to recalibrate a new rating goal that allows for the impact of these assumptions (eg MJ/m2.annum or stars).  In this scenario, the consumer would only need to know if the dwelling has complied or not.

Perhaps we need two NatHERS compliance pathways. One based on defaults that gives the consumer a pass or fail certificate. The other, provides a star rating and uses the software at a higher level, allowing for those who want to use the software as a design tool or to show their clients just how cost effective, energy efficient and comfortable their house is, comparatively out of 10.

This detailed assessment pathway, for example, may require further experience, training, examination or accreditation to be permitted to use the software in this way.

An example of a ‘simple’ comparative system already exists within the ACT as part of the point of sale disclosure of a star rating.  The EER certificates required are calculated using FirstRate4. FR4 is a first generation NatHERS software. The currently approved software we use today is second generation software.  FirstRate4 does not even include a calculation engine. It correlates data gathered about similar properties from the two other first generation software, NatHERS and BERS, both containing early versions of the Chenath Engine. All these software packages used 4 zones with rooms combined by type and a limited default range of products and glazing inclusions. Data entry was quick and simple making it easier to achieve consistency. The fact that the output is a correlation rather than a calculation further broadens the margin for error and is therefore more suited to dwellings that are already built where the Assessor has to make numerous assumptions and often measure up the dwelling for assessment. There have also been studies that show pre building assessment and post building assessment do no align in a large percentages of cases further begging the question, why would you try to be so accurate in the first place if when all is said and done, the rating produced does not correlate with the final dwelling the occupants inhabit, even if the same software and methodology is used?

So, what are your thoughts? Does every assessment require absolute accuracy? What areas do you think could be set to a default level? Could we create an extra income stream for NatHERS Assessors by having both an application and an ‘as built’ stage assessment? Let us know in the comments section below!

Recent Blog Posts Testimonials

“Ease of delivery, completing from work”

Qld Health

“I engaged Michael Young from Transformed to assess me for the Australian Institute of Project Management Certified Practicing Project Manager. I wanted to be certified as I wanted to verify that the skills and knowledge was in line with industry best-practice. At first it seemed a bit daunting, however, Michael made the process very easy, providing templates for references and self-assessment as well as providing a list of the project management documents I would need to provide as evidence. The assessment interview was very relaxed and more like a conversation than an assessment, which brought out the best experiences to evidence my capabilities. Because of Michael’s current government security clearance, we were able to look at specific of particular projects, rather me than having to spend a heap of time sanitising documents. Since the assessment, I have been successful in gaining a promotion..”

Mike McCarthy

“Just wanted to say thank you so much for offering such a great course, I have really enjoyed studying my Certificate IV in Home Energy Efficiency and Sustainability with Transformed”.

Cert IV in HEES student, July 2021

“I am so appreciative of you and Transformed for your flexibility and support- THANK YOU”

Louise Anderson
Cert IV in P & C student - May 2020

“The self-paced learning it allowed me to work whilst studying”

Haylea Edwards
Efficient Living

“Easy to deal with”

Laura Lace

“I’m extremely impressed by The Cert IV in HEES delivered by Transformed. It is a fantastic, relevant, and interesting course with great content. The study materials and assistance have been exceptional. Thanks again to Transformed for their support”.

Matt Wade
Cert IV in HEES Student – April 2022.

“Phenomenal course to understand contract management in the best way possible. I am working as a Procurement Manager and never understood contract part completely but this course helped me to understand key points of contract management. Thanks to author for creating this wonderful course. ”

Student - Introduction to Contract Management - August 2021

“Don has been a terrific teacher and very prompt with feedback throughout the whole diploma, which has been great!”

Diploma of PM

“The excellent and prompt communication from my assessor”

Cert IV in NatHERS Assessment student

“…I originally enrolled in Transformed’s Diploma of Project Management on the basis of their flexibility. ..As I subsequently discovered, Transformed’s approach extends even further to include ‘one on one’ coaching sessions… and adjusting the training to fit in with the client..”

Michael Irwin

“I think everything worked very smoothly”

Susan Mariott
Quality Home Design and Drafting Service

Completing my CPP41119Certificate Home Energy Efficiency & Sustainability course has been a significant step in my professional journey.
Thank you for your support and guidance and every single subject in this course you have taught me

Cert IV HEES student - April 2024

“All round I’ve been really impressed with how professional everyone at Transformed has been”

Diploma of PM

“I found the course easy to follow and navigate through. I would recommend this course to others”

August 2018

“The course is really well organised, your videos and zoom meetings were extremely helpful, the platform functions perfectly, your response time to queries and questions is always prompt and overall it is just been a wonderful experience”

Cert IV in HEES student, July 2021.

“Thanks for your support over the years and I look forward to doing more courses at Transformed in the future”.

Cert IV in HEES - March 2022

“I am very satisfy with the study”

Eric Lam

“Always good and prompt feedback from Michael”

John Logan
Draft Comps Services

“I also want to take the opportunity to thank you for all your help during my studies. I think your training company is very professional and I would endorse you and Transformed to anyone looking to study distance learning”

Doug Madarovski

“Learning – I have now fine-tuned my existing skills”

Brian Peterson
Moreton Bay Regional Council

“My assessor was absolutely fantastic and I couldn’t have achieved this without her encouragement and guidance’.

Cert IV in Procurement & Contracting - March 2022

“Just wanted to say thanks for putting up with me and getting me over the line!! Which I know was a bit difficult with no background in the industry!! Thanks very much and I look forward to starting my business and conquering the world as an Energy Rater!”

Laura Lace

“Working at my own pace online and the response time to emails and responses were always great”

Ekaterina Sidorova
Lend Lease

“The most practical and well organised course I’ve been involved with, perfect for anyone with a demanding full time career and family commitments. My facilitator was extremely helpful and being part of the construction industry applied a very focused approach to the course content which assisted me in completing my studies, Would strongly and have already recommended Transformed to those looking to complete their Cert IV and Diploma in Building and Construction. Thanks for all your efforts and support.”

Aleks Petrovic
Cert IV and Diploma in Building and Construction Student

“I want to thank you for providing that encouragement and feed back at appropriate times. You make me and I’m sure all students, feel special and like we are getting personal assistance, which I have received. I don’t know how you manage all that you do but you do it well. Thank you”

Cert IV in NatHERS Assessment student