Item 4 is a response from the accountable officer on the report "Day surgery in Scotland—Reviewing Progress". I invite thoughts and comments. Could it just be a question of noting the report?
Official Report · Committee
Section 23 Reports: Responses
“Day surgery in Scotland—Reviewing progress”
Speakers
Choose an MSP to read only their contributions- Hugh Henry Lab 9
- Andrew Welsh SNP 5
- Mr Black 5
- Caroline Gardner 5
- George Foulkes Lab 3
- Cathie Craigie Lab 1
- Stuart McMillan SNP 1
- Tracey Reilly Clerk 1
- Nicol Stephen LD 1
The record
31 contributionsI want to ask about the significance of the second paragraph on the second page of the response. It says:"Boards … are now shifting a significant amount of activity into outpatient settings. The accuracy of clinical coding pertaining to procedures delivered in an outpatient setting is considered to have an adverse impact on reported national performance figures."The end of that paragraph says:"An associated analysis suggests that there are also a number of patients within each NHS Board whose procedure is delivered as a day case but whose attendance is coded as an in-patient admission."What is the significance of that? It sounds rather confused.
It is the same issue as before. It is about how information is recorded. We constantly come up against that and it is an area that requires development.
But there are BADS, HEAT and the other acronyms that they throw at us.
When people were admitted as in-patients to get operations done, that was pretty easy to count and measure. Now, people can be treated as in-patients, day cases or out-patients for the same condition, so it is much less clear now that the information is full and complete. That is what that paragraph means.
If the information is not full and complete, is that because of negligence on the part of those who record information, because of a failure in each location to apply recognised procedures properly, or because the systems and procedures are not there to apply consistently across the country?
It is closest to being the third of those. The underlying problem is that the systems for collecting the information have not kept pace with changes in the way in which treatment is provided. It used to be straightforward: everybody who was admitted to an in-patient ward was counted as they came in and went out. However, with people coming into day-case units for part of the day or turning up at out-patient units for a couple of hours, it is more complex to collect consistent information about, for example, the total number of patients having a cataract done—as well as the numbers for each of three settings. The systems have not kept up to date with the changes.
How difficult or cumbersome is it for the NHS as a whole to apply consistent systems and for people to use and adapt them?
There is obviously a question around ensuring that the systems are straightforward and easy to use and that people know how to use them and understand the importance of using them. Many of our reports show that they are not working so well in a range of areas. We are aware of that in day surgery, which is the subject of the report in front of us, and we also came across it earlier in relation to the palliative care system. One of the themes that have come through in our work over a number of years, particularly on the health service, is that collecting information is much harder than it appears. It needs serious attention, given the importance of information for planning and managing services.
We are not for a moment suggesting that the health service should collect more and more information; we are suggesting that the information that is collected should be fit for purpose in managing the NHS.
The visits of patients are being recorded differently, depending on whether they are they are there for three hours, 24 hours or longer. If boards are collecting information in different ways, what impact could that have on the recording of the targets that they are expected to meet for the various aspects of day-care and in-patient services? Are there benefits for boards in recording different areas of information differently?
The short answer is that there should not be benefits to doing that now. There might have been in the past, particularly when contracting systems were in place, under which people got paid different amounts of money for different procedures, but those systems do not apply any more. There are two serious effects. First, it is hard for us to tell which boards are doing better and which are doing less well if they are not being consistent in how they collect information. Secondly, and much more importantly, and as Bob Black has said, the health service might not have the right information to determine how it can improve the care that it provides or the value for money that it offers by treating patients' needs in a more appropriate place. That is the problem as we see it.
A problem that I have always had is that, in the final analysis, statistics are simply a means to an end; they are not in themselves the end. We seem to be getting many statistics for their own sake rather than for a purpose or a practical end result. I have a difficulty with that. There is a difference between reality and dealing with statistical effects only. For example, Dr Woods's letter refers to the estimate that"a 5-10% improvement in overall same day care rates could be demonstrated through a simple improvement in procedure coding."There is a danger that, simply by changing the statistics or the way in which things are looked at, it will appear that improvements have been made when they have not necessarily been. That is a general problem.
I would like to leave the report that we are discussing to the side for the moment and make a suggestion, although I do not know whether it is appropriate. Members are saying—the Auditor General has also raised the matter—that there is a consistent issue. The same thing comes up time and again with a range of issues in the NHS—I do not know whether the same happens elsewhere. Could you do a short piece of work for us that identifies recording and statistical issues in the NHS under topic headings so that we can find out whether we can suggest changes to achieve consistency, improvement and better management? Repeating the same discussion time and again does not seem to be a good use of our time. Can something be done to pull things together?
I am sure that Audit Scotland can revisit reports that we have produced in the reasonably recent past and derive common themes.
I agree with the Auditor General. A number of reports that we have produced over the past couple of years have had an underlying theme. Baseline information on new policies that have been introduced has not been clear, and we have reported several times that the information in clinical areas such as day surgery did not give a full picture of what was happening. We would be happy to look back at those reports and produce a short piece of work for the committee that summarises things.
That would certainly be helpful. Thank you.Is there anything further that members would like to do in response to the report on day surgery in Scotland? If not, we can simply note it.
link
I have quite a pedantic point to make, but Cathie Craigie will subscribe to it—I say the same in Justice Committee meetings from time to time. It might be an idea if letters were proofread—by the health directorates in this case—before they are sent to us. There are quite a few errors in the final sentence alone in the first paragraph on the final page of Dr Woods's response. The point is pedantic, but if the directorates cannot even proofread letters, the information in them—
We can certainly send a letter to Dr Woods asking for that to happen.
I shall pass that on.
We are pointing to a problem in the central organisation. It is dealing with a complicated situation throughout the country, but a reporting and statistics industry exists that is unrelated to actual needs. I have seen the same in education colleges—staff produced reports simply for headquarters. That is a fundamental organisational problem. Everybody must accept that the situation is complex, but it is the organisation's job to get order out of that complexity and use statistics to get the work done. An industry is working on its own that is somewhat unrelated to the real world.
Convener, will you remind me whether the health committee gets the Auditor General's reports on issues for which it is responsible?
Every MSP receives a copy of the reports that Audit Scotland produces.
But the health committee does not consider reports in the way that we do.
No. All reports that are produced for me go to the Audit Committee. That is the parliamentary procedure. However, the other committees may request briefings from us on our reports on individual topics.
The reason why I ask is that we have had a lot of reports about the health service. Andrew Welsh has represented better than anyone our dissatisfaction with many of them. Should we have some kind of interaction with the health committee to raise that general point? We can say that we have received those reports and that there seems to be a generic issue, and then ask the health committee to consider picking up the issue. I do not know what the best way of doing that would be.
Okay. We will leave that sticking for now.
I want to return to your point, convener, about a piece of work that looks across the whole of the Government. My experience of how statistics are collected in the Government is that there are differences from department to department. Some departments have substantial teams to collect statistics. Some of those teams are reasonably well integrated into the senior management of the department but, in other cases, the integration is poor. I do not have direct experience of the health department, but it does not look good when the senior official in the department says that the statistics are unreliable—in effect, that is the answer that we are given when he talks about coding difficulties. If senior managers start to believe that some or most of the statistics are unreliable, the statistics become a particularly useless management tool.That takes us back to Andrew Welsh's point that a substantial number of people are gathering statistics as an industry in its own right, not to assist with the management and improvement of a department or organisation. Shining a far clearer and sharper light on that would deliver results and would be valuable, provided that the Government acted on the outcome. I get increasingly frustrated by the constant and consistent rebuttal of any criticism or attempt to support and improve the service. When we raise concerns or find inconsistencies between health boards, we are told consistently that it is difficult to say that there are differences and that the issues that we have found can be explained by the way in which statistics are gathered—they are not gathered very well in some health board areas. I have seen exactly the same explanations about statistics in education. That becomes frustrating, not just for MSPs but for any patient, pupil or parent who is observing the situation and wants improvement. Anybody who is interested in health or education in Scotland deserves better.
The question is what we do on the bigger issue and on the specific issue. On the bigger issue, certainly in relation to health, we can consider inviting the Health and Sport Committee or its convener and deputy convener to come along for a short discussion. If members leave that with me, we will consider the best way in which to proceed. We will come back to the statistics issue once Audit Scotland has done further work on it.Our options on the day surgery report are to note it, take up some of the specific issues again or refer it on to the Health and Sport Committee. Any referral to the Health and Sport Committee should probably wait until we have had the general discussion about what is happening, as well as the discussion on the statistical recording issues. I am not sure that there is anything further that we can usefully do on day surgery, so I am inclined simply to note the report, unless members think that something more specific should be done.
We cannot pre-empt in any way—nor should we—the work of the Health and Sport Committee. However, we can alert it to matters that affect its work, and therefore we could bring the report to its attention. In other words, we should hand the tools to the Health and Sport Committee to allow it to do its work.
Okay. Do we agree to note the day surgery report and pursue both the interface with the Health and Sport Committee and the recording of statistics?Members indicated agreement.
In this meeting
Everything on 12 Nov 2008 →- Scottish Parliament Audit Committee Wednesday 12 November 2008 Committee business · 1
- Decision on Taking Business in Private Procedure · 2
- Decision on Taking Business in Private Procedure · 28
- Section 23 Reports: Responses Committee business · 21
- Section 23 Reports: Responses Committee business · 31
- Section 23 Reports: Responses Committee business · 26
- Section 23 Reports: Responses Committee business · 21
- Section 23 Reports: Responses Committee business · 9
The type of each item (debate, statement, questions, members’ business and so on) and the times shown are worked out by this site from headings, the chair’s opening words and the Official Report’s running timestamps. They are not the Parliament’s own classification. Text: the Scottish Parliament Official Report.