360 Degree Feedback Impact Study
360 Degree Feedback Impact Study
uk
Provided by Research Papers in Economics
T. V. Rao
Nandini Chawla
W.P. No.2008-06-02
June 2008
The main objective of the working paper series of the IIMA is to help faculty members,
research staff and doctoral students to speedily share their research findings with professional
colleagues and test their research findings at the pre-publication stage. IIMA is committed to
maintain academic freedom. The opinion(s), view(s) and conclusion(s) expressed in the
working paper are those of the authors and not that of IIMA.
T. V. Rao
Nandini Chawla
EXECUTIVE SUMMARY
A large number of organizations have been using 360 degree feedback in India as
leadership development intervention. This paper is based on the feedback of 43
participants from four companies where the 360 Degree Feedback program was initiated.
The study was done using a questionnaire method. The results indicated that there has
been an overall positive impact reported of 360 Degree intervention on ones professional
life after 360DF. More than 60% of the participants report that they visited 360DF data
every quarter. 24 participants reported that about 50% of their action plans prepared at
the end of the 360 intervention were implemented. At least 30% of the action plans were
achieved by 6 of the participants and 2 participants reported achievement of all their
action plans. The participants also reported that the RSDQ model based 360DF tool
provided detailed insight covering various parameters of one’s role. The participants also
recommend that with more periodic follow up and review sessions (every quarter)
anchored by internal HR and more focus and seriousness among the participants to work
on the action plans will result in using 360 DF for change and growth
1
The data reported here were gathered by the authors as a part of the 360 degree feedback based Leadership
Development programs of TVRLS at Bangalore. The assistance given by Ms. Tejal Rathore is
acknowledged.
W.P. No. 2008-06-02 Page No. 2
IIMA y INDIA
Research and Publications
Introduction
360 Degree feedback (360 DF) has emerged as one of the most used interventions of
recent years for leadership development (see for the number of organizations conducting
360 Degree feedback based interventions Rao, Vijayalakshmi and Rao, 2000; Rao,
Mahapatra, Rao and Chawla , 2002; Rao and Chawla, 2005; Vohra and Singh, 2005 etc.).
360-degree feedback has been linked to several positive outcomes like improved
performance, better interpersonal communication, smoother work relationships, etc. (Rai
and Singh, 2005). In a recent study of the mediating effects of 360 Degree feedback
Himanshu Rai and Manjari Singh (2005) empirically examined the mediating effects in
the relationship between 360-degree feedback and employee performance with a sample
of executives (N=198) working in four organisations in Western India. The results
showed that interpersonal communication and quality of working life had a complete
mediating effect. Leader member exchange quality and perceived organisational support
were found to have a partial but significant mediating effect.
Studies in general on the use of 360 Degree feedback are limited. Raju Rao (see in Rao,
Vijayalakshmi and Rao, 2000) reports a follow up study of 32 candidates who underwent
360 degree feedback a few months after the feedback. The survey using interviews
largely as a method revealed that the participants were still implementing their action
plans, some of them shared with their juniors and seniors their data and are busy
validating the same. In another study reported by the same author where a questionnaire
was survey was used to follow up (number of candidates not mentioned) a number of
changes were reported by the respondents including articulating vision, enhancing
internal customer orientation, change in leadership styles etc. However this study did not
offer any conclusive evidence of changes.
In another study reported by Rao and Annapurna (2005) 18 participants were assessed on
the same tool one year after the first assessment. The comparison of the two assessments
indicated a number of changes as assessed by the participants. For example:
Eight of the 18 participations (45%) showed improvements in all areas of the RSDQ
MODEL BASED questionnaire. Vision, customer focus, encouragement of juniors,
communication, motivation and increased activity level and marketing activities etc. are
some of the frequently observed changes as reported by their juniors, colleagues and
bosses after the 360 DF. The changes observed were both positive and negative though
they were more in the direction of positive changes. Leadership style changes were also
observed though in a few respondents.
The present study was undertaken as an in-depth study of various activities undertaken by
the respondents after an initial exposure to the 360 DF. The survey was conducted as a
part of the follow up workshop of the respondents who had undergone the 360 Degree
feedback.
They were sent a questionnaire and the analysis is based on the responses received.
Methodology
Based on the work done at IIM in mid eighties and subsequent work in 360 Degree
feedback RSDQ a research based consulting firm with which the authors have been
associated developed a model for Top and Senior Management in terms of managerial
and leadership competencies needed, which is termed as the RSDQ model (Roles, Styles,
Delegation and Qualities). This model of leadership and managerial effectiveness views
effective management and leadership as a combination of four sets of variables. These
are: Roles performed the style of leadership, delegation and qualities.
Roles: There are a number of roles, which have to be played by every manager in order to
be effective as managers. These are both transformation roles (leadership roles) and
transactional roles (managerial). Some of these are: Vision and values, strategic
orientation, Inspiring, developing and empowering employees, Customer focus, internal
customer orientation, community orientation, communication, Innovation and learning,
Result orientation, Technology and systems management, Leadership, team work and
boss, Decision making and delegation etc. Each of these roles had both transactional and
transformational activities. For example, “articulating vision and values for the
Styles: It is not only the roles or activities that determine the effectiveness but also the
way in which they are played. The model envisages that managers could be insensitive to
the style with which they carry out these activities. Rao (1986) has classified the
leadership styles, on the basis of the earlier research at the Indian Institute of
Management, into the following:
(i) Benevolent or Paternalistic leadership style in which the top level manager plays the
role of a parent. (S)he believes that all employees should be constantly guided treated
with affection like parents would treat their children, is relationship oriented, assigns
tasks on the basis of her/his own likes and dislikes, constantly guides them and protects
them, understands their needs, salvages the situations of crisis by active involvement of
herself/himself, distributes rewards to those who are loyal and obedient, shares
information with those who are close to her/him, etc.
(ii) Critical leadership style is characterized as closer to Theory X belief pattern where
the manager believes that employees should be closely and constantly supervised,
directed and reminded of their duties and responsibilities, is short term goal oriented,
cannot tolerate mistakes or conflicts among employees, personal power dominated, keeps
all information to himself, works strictly according to norms and rules and regulations
and is highly discipline oriented.
(iii) Developmental leadership style is characterized as an empowering style. The top
manager believes in developing the competencies of her/his staff, treats them as mature
adults, leaves them on their own most of the times, is long term goal oriented, shares
information with all to build their competencies, facilitates the resolution of conflicts and
mistakes by the employees themselves with minimal involvement from her/his side.
Developmental style by nature seems to be the most desired organization building style.
However some individuals and some situations require at times benevolent and critical
styles. Some managers are not aware of the predominant style they tend to use and the
effects their style is producing on their employees.
Delegation: Most senior managers seem to have difficulties delegating, especially those
effective managers who get promotions fast in their career. In view of these experiences,
W.P. No. 2008-06-02 Page No. 5
IIMA y INDIA
Research and Publications
Qualities: The model envisages that managers should exhibit qualities of leaders and
world-class managers (e.g. proaction, listening, communication, positive approach,
participative nature, quality orientation etc.). Such qualities not only affect effectiveness
with which top-level managers perform various roles but also have an impact on the
leadership style and hence are very critical.
The 360 Degree feedback based on this model is being extensively used by Indian
corporate sector. In four of the organizations the 360 Degree feedback using the RSDQ
model was provided. The feedback was collected anonymously and was given to each of
the participants from the four organizations. The feedback was given in a workshop
followed by individual coaching by the authors of this paper. The feedback session ended
with action plan prepared by the participants for leveraging their strengths as well as
working on other priority area emerging from the feedback. Under normal circumstances
it I assumed that the individual participant will work on the feedback and demonstrate
changes. Whether the participant has shown behaviour changes or not can be ascertained
by contacting the same assessors after a few months to a year and get them assessed.
However a limitation in 360 methodologies is to get anonymous assessments. As a result,
while the same assessor can be contacted the assessment can be compared at the
aggregate levels only (see the study by Rao and Annapurna, 2005) using this
methodology. However some times all changes may be observable by observers. For
example changes in emotional stability may be more noticeable by the individual than
always by the outside observers. While the external observable changes are critical for
any leadership development conclusions to be drawn self-reported changes cannot be
underplayed. This is for the following reasons:
1. After the 360 degree feedback those who assessed the candidate may develop
higher expectations from the candidate and may use higher standards of
judgement. It is quite common for assessors to say he has not changed even after
the 360 DF while the candidates may report that they have changed substantially.
The survey is based on 43 candidates who underwent the 360 Degree feedback
Intervention from four organizations. All the members are members of the top
management team and were heading various functions. The questionnaire was sent to
them to assess the impact of the 360 degree feedback interventions one year after the
intervention was made.
The impact report is presented in four sections: Individual impact, Organizational Impact
Reactions to methodology, recommendations for making the intervention more effective
and conclusions
Under RSDQ methodology category the questions focussed on the following areas:
` Positive points about RSDQ methodology of 360 Degree Feedback
` Areas of improvement for RSDQ 360 Degree Feedback methodology
The last question dealt with suggestions for making 360DF a continuous improvement
process.
This questionnaire was answered by 43 participants who attended the 360 degree
feedback workshop. This report compiles the data of four companies and gives you an
analysis on each area and suggests the steps that can be taken to make 360 Degree
Feedback more effective.
` 20 individuals felt that 75% of leadership development was achieved through 360
Degree Feedback
` 14 individuals felt that leadership development was achieved to an extent of 50%
through 360 Degree Feedback
` 2 individuals felt that leadership development was achieved to a limited extent i.e.
less than 50%
` 1 individual felt that leadership development was achieved to an extent of 25%
through 360 Degree Feedback
` 3 felt that no development was achieved
A. Professional life:
• 39 out of 43 participants felt that there was certainly an improvement in a positive
way after having undergone the 360 Degree Feedback process.
B. Personal life:
Unlike professional life there were mixed reactions to the impact of 360 degree feedback
at a personal level.
• 30 individuals felt that 360degree feedback had made a positive impact in their
personal life.
• 13 individuals felt that there was no visible change in their personal life as an
impact of 360 degree feedback
The common areas where participants observed a change after 360 degree feedback are:
W.P. No. 2008-06-02 Page No. 10
IIMA y INDIA
Research and Publications
6. WHAT ARE THE THREE AREAS WHERE YOU HAVE NOT BEEN ABLE
TO IMPROVE UPON AND SEE THE CHANGES THAT YOU EXPECTED
OR DESIRED?
The common areas where participants have not been able to observe change after 360 degree
feedback are:
` Accountability
` Adhering to deadlines
` Art of Influencing skills
` Art of public speaking
` At times, tend to force / emphasis my point of view
` Being diplomatic
` Better Delegation
` Better time management
` Better understanding of business and ground realities through field visits
` Cannot compromise on things which I could not influence
` Complacency – New learning are limited
` Conflict management: cannot accept failures as well as judging others by my own
benchmark
` Conflict management: desire to achieve more effectiveness
` Controlling my temper (specially when things don’t happen as per my plan)
` Could not take the initiative to all levels of the organization
` Creating development opportunities
` Encourage team members to take more independent decisions
` Enhance networking with peers/colleagues
` Ensuring a peaceful, composed & appealing body language while discussing issues with
others and even during conflicts. This is true especially when someone is
criticizing/commenting on issues pertaining to ones own area of responsibility.
` Focus more upon developing on the leadership style
` Generally trusts everyone- still do
` Giving focused direction
` Giving up more commitments
` Grade change
` Highlighting the good work
` Impact / convince the boss to the desired level.
` Improve team building
` Improved communication
` Improvement in presentation skills
` Improvement on IT/Computer skills
` Improving Technical Knowledge for self
` Impulsiveness
` Inadequacy of power to take decisions
` Irritable nature
` Liaison with top management and better communication
` Monitoring development of desired organizational culture
` More openness and frank discussion from junior colleagues
W.P. No. 2008-06-02 Page No. 14
IIMA y INDIA
Research and Publications
` Work life balance – time management (to nurture good things in me)
The three main hurdles in implementing the action plan perceived are given as below:
` Absence of delegation of responsibilities with accountability at organizational
level.
` Attitude of people in key positions
` Change of mindset
` Clutter in mind about too many issues
` Colleagues and peers opinion of me- communication issue
` Colleagues/peers, subordinates do not come out in open about what has been
written as feedback. Most of them do not accept that it has been written so in the
feedback form.
` Compartmentalization which gives rise to politics and plotting one against other.
` Conscious efforts in implementing action plan needs to be religiously made which
more often than not does not happen
` Continued mounting work pressures and no immediate supporting resource made
available in the office.
` Day-to-day administrative work load and crisis management
` Difficulty in transition from benevolent to development category
` Dominant individual styles affecting the business processes
` Empowering people
` Even though individual development plans were set up, implementation and follow up
has not been up to the mark
` Getting caught up in the daily grind of work. Unable to effectively implement the
plan
` Have implemented the action plans wherever it is possible. The change has to be
initiated in some levels where my role becomes difficult
` Implementation at superiors level was difficult
` Individual apathy to OD initiative and the attitude that ‘its just a fad’ will just pass
off is the attitude with some colleagues
W.P. No. 2008-06-02 Page No. 16
IIMA y INDIA
Research and Publications
` Time gap in 1st and 2nd round. You do not know changes that have happened. You
think you have changed but is it true
` Time Management
` Time to look back at the details of my feedback and follow the theoretical aspect
of it
` Very little after a frank and open discussion
` Work Pressure
` Work pressure of new function
This question was answered by very few individuals and some of the examples are given
below:
360 degree feedback has helped in developing a positive outlook and has also
made the individual more sensitive
A positive approach to 360 feedback and considered it as an eye opener
At least two of my colleagues have shown a positive development of
understanding the others point of view in the corporate management team.
Changes observed initially have been short lived in some of the cases
Communication from Top management by understanding individuals more.
Difficult to identify, meaning no significant changes
Discussions of the issues based on facts, accepting that issues exist. However,
limitations are on owning the responsibility for deviations, deployment of
corrective actions and facilitating the overlap activities still needs improvement
Enhance ability to understand other person’s view point
Enlightenment has improved in people. They have realized their stand vis-à-vis
the opinion of the people and are trying to improve to a great extent.
There is an increased ability to assess the right requirements and take care of
several interests.
Visible change in the leadership style for the betterment of the branch is observed
(from benevolent to developmental leadership style)
Yes, some have become more sociable, approachable and have began to
understand subordinates better
RSDQ METHODOLOGY
10. WHAT DID YOU LIKE ABOUT RSDQ MODEL BASED METHODOLOGY
OF CONDUCTING 360-DEGREE FEEDBACK?
` 360 Degree feedback can be introduced after 3 level immediately and to all
management personal stage by stage
` A very long gap as in the present case is to be avoided and review to be done at
least once in six months.
` Additional focus on changing Leaderships attitude and working style.
` Assign a HR person to periodically interact with the individual with a open mind
` Based on the 360DF report, the organization has to analyze and watch the
improvement of individuals in a time bound manner. If the change is not happening,
stringent actions have to be initiated to correct the individuals.
` Can be more personalized – more time per participant
` Can include some case studies (Real ones)
W.P. No. 2008-06-02 Page No. 25
IIMA y INDIA
Research and Publications
The common suggestions in order to make 360degree feedback a continuous process are
given as below.
` 360 degree feedback should be conducted in regular intervals to check the impact.
` 360 DF should be a continuous process, every change in job profile demands fresh
360DF. Include 360 DF for family members also
` Continuous contact with the participants on a regular basis
` The faculty are the best available for this kind of activity. One wishes that we get an
opportunity to meet them again on a regular basis.
` Feedback review sessions should be conducted every quarter
` Implement a system of reminding the “leader” about the Action Plan they have laid
down for themselves, so that a conscious attempt can be made to perpetuate the
behaviour
` In consultation with the facilitator the company can make a self assessment tool for
every employee and make the same mandatory in terms of implementation yearly
` Invite guest speakers from other organizations to share their learning and views &
also to share how they have used their feedback for growth and development.
` It has to be a ongoing process and changes made as per the need
` Make people aware on what they can change and what they cannot.
` May be online feedback
` More focus to bring about change in the attitude of the Leadership as culture is always
top down. It is pointless if change cannot be brought about unless it is from the top.
` No suggestions. The ball is in our court to take on and act.
` Review once a year. Internal review once in 6 months
` Superiors also are involved or present as observers during the review. It should be
done on a regular basis and at all levels
` The 360 Degree Feedback review to be conducted by a live example who has used
this tool to develop and progress
` The whole concept of 360 DF is feedback and therefore need to plan a very regular
quarterly feedback at the time of launching the programme.
` We could do 360 DF at least with subordinates and peers more often
` Yearly feedback is ok. We should be interacting with Dr. Rao more often over e-mail
References
M Singh, N Vohra Multi-faceted feedback for organisational heads for self and
organisational development: experiences International Journal of Training and
Development, 2005, September, 9(3)
Neharika Vohra, and Manjari Singh, Mental traps to avoid while interpreting feedback:
Insights from administering feedback to school Principals, Human Resources
Development Quarterly, 2005, 16(1), 139-147.
Rai, Himanshu and Singh, Manjari, Mediating Effects in the Relationship between 360-
Degree Feedback and Employee Performance, Ahmedabad: Indian Institute of
management, Working Papers, 2005 (W.P. No. 2005-04-06)
Rao, T. V. and Chawla, Nandini 360 Degree feedback and Assessment and Development
Centres, New Delhi: Excel Publications, 2005
Rao, T. V. and Rao, Raju, 2003 The Power of 360 Degree Feedback, New Delhi: Sage
Response Books.
Rao, T. V. Mahapatra, G, Rao, Raju and Chawla, Nandini. 360 Degree feedback and
Performance management Systems, New Delhi: Excel Publications, 2002
Rao, T. V. Vijayalakshmi, M and Rao, Raju: 360 Degree feedback and performance
Management Systems, New Delhi: Excel Publications, 2000
Appendix
Additional comments:
2. How often have you visited your 360 feedback data after the feedback
workshop?
a. Never visited
b. Once in every month
c. Once every quarter
d. Once in every 6 months
e. Once in a year
Additional comments:
Additional comments:
4. How successful have you been in implementing the action plans you set
for your self at the end of the workshop?
a. Have not been able to work on it at all
b. Have accomplished around 30% of what I set out to do
c. Have accomplished almost 50% of what I have put down as action
plans
d. Have achieved what ever I have listed down in my action plan
Additional comments:
5. Top three changes that you have observed in yourself after the 360-
degree feedback?
1.
2.
3.
6. What are the three areas where you have not been able to improve upon
and see the changes that you expected or desired?
1.
2.
3.
7. What are the biggest hurdles you faced in implementing your 360-degree
feedback action plan?
8. Have you felt any significant changes taking place at the organizational
level after the 360 degree feedback implementation?
9. Please share some examples and/or instances of people where you feel
they have undergone significant changes after they received their 360
10. What did you like about RSDQ MODEL BASED methodology of
conducting 360-degree feedback?
methodology?
12. Your suggestions to make the 360 feedback journey a more powerful and
a continuous improvement process?
Your suggestions: