I was talking to my friends at Trampoline Systems today and I started thinking about one of the bastions of E2. The almighty tag. Not the “dog”, “price”, or “surefire way to date a horrible woman“variety but the kind that generate folksonomies. The thought was that maybe tags could be used for other things. I haven’t seen every tag cloud/heatmap, but they usually seem focused on providing an emergent and pliable organizational construct designed to aid in quickly assessing and using a larger set of information. Muy bueno for sure, but what if you used tags to aid in assessing and using the capabilities of a person.
As an aside, does anyone else feel like folksonomy is kind of a funny word for the ones and zeros crowd? It seems a little too patchwork pants, veggie burritos, and Sam Smith, doesn’t it? Who knows…maybe Thomas Vander Wal is a big Leftover Salmon fan.
Righto….back to tags and performance management.
One of the neato features of Trampoline’s SONAR application was the use of NLP to derive themes (tags) from indexed emails or other corporate content. Put simply, if I create a lot of corporate content about “Shrek” my profile is tagged with “Shrek” (and probably “animation”, “pink-slip”, and “single”). Point being is that this approach gets around the issue of people tagging themselves with “database administration” or “useful” when in reality, they are “java developers” or “lawyers”. (I kid. Really. I love lawyers. Each and every one of the 6 million of you who live in DC.)
I called this phenomenon “alter-ego-projecting” in my previous post, and would guess it is a major drawback of something like Facebook when brought within the walls of a company. Especially a knowledge-worker or professional services firm. Let’s face it. For corporations, the theme-thyself only model of Facebook will fall on its face tomorrow, in the same way competency management did yesterday. On my Facebook profile, my favorite quote is the Helen Keller oldie but goody “life is a daring adventure, or nothing at all.” In reality, I am afraid of heights and fear the worst every time there is in-flight turbulence.
So now take this concept and apply it to performance management…
If you work for a largish organization, it is probably fair to assume that there is some sort of goal-setting and subsequent evaluation process. In an attempt to provide some equality and career growth guidance, the HR folks have divined standard metrics, categories, and other means by which to develop goals, and subsequently evaluate your performance against them. There is a usually a mix of qualitative and quantitative data that provides your superiors input in a resulting HR or managerial action. You could be promoted. You could be counseled. You could be moved to a different part of the organization. You could be given a bonus. You could be rapped upon your knuckles with a ruler. (Maybe that last one only happens to me…)
The qualitative part of this process has always sort of bothered me. In a matrix organization, where you are moved from project to project, and advancement hinges upon a combination of project and functional leadership input, I feel that project reviews and other qualitative input are somewhat lacking in utility. Either people do not have the time to write a review, or an evaluator has little time to read the review. Also, if pressed to present evidence of performance, most people will more than likely only present the most positive reviews. To get around some of these issues, I propose the following performance management system concept:
Develop “performance tag/theme clouds” for people based on indexing and NLP of qualitative reviews. Present this information to evaluators as a means to quickly understand and assess a somewhat large amount of performance related data. Define tag clouds based on corporate content from formal project reviews, self-assessments, and an ad-hoc review email repository. The first two sources are probably self explanatory, but the third…maybe not so much. Simply put, the ad-hoc email repository would be a “place” (like an mailbox) where both the employee and evaluator could send performance related emails. More than likely any negative feedback would be sent to the supervisor anyway, and positive would be sent to both. Forward those notes along to the “performance mailbox” and have the content added to the tag cloud. Also, allow for anyone in the organization to anonymously send performance-related emails to the mailbox. (Whoah…anyone? Yes. Anyone.). Maybe even allow for both employees and evaluators to add manual tags to the emails as they are submitted/reviewed.
As this tag cloud develops, both an employee and a supervisor will see emerging performance themes. If tags like “competent” and “innovative” are assigned a greater font weight, perhaps this employees deserves a raise. Conversely, if tags like “unsatisfied” and “moron” rise to the top, maybe it’s time to polish up the resume. You could even quantify the delta between this year’s tag cloud and last year to show progress over time. Finally, the evaluator can drill down to the specific emails or reviews that produce themes of interest (like moron) to see if there was real substance behind the attribute.
The benefits of this approach is that it gives employees and supervisors a quick and easy way to augment the performance assessment process. Instead of trying to wade through reams of text, both evaluators and employees can see key performance themes and better focus the performance management process. Also, the decision making process is made better by leveraging content from a greater variety of sources.
So what do you think? Is the performance management world ready for the Clifford Ball approach?



11 responses so far ↓
1 Steve Ardire // Mar 28, 2008 at 7:25 pm
Nate - your posts are very entertaining AND provocative reads !
2 Jay Hariani // Mar 28, 2008 at 9:11 pm
Interesting piece Nate. Enterprise tagging of employee work products or employees themselves is a good idea. Any technology that adds an element of meritocracy to the enterprise will boost productivity and help vet out good, bad and mediocre employees in a way that works better then traditional performance reviews.
3 Eben Halford // Mar 28, 2008 at 10:12 pm
Have u used Jobster or GoJobby (before Jobster snapped em up) - coming at it from a slightly different angle than the SONAR platform but what if they were mashed up based on individuals having access the data that the enterprise ‘tags’ em with - throw in a bit of classic ‘trust by proxy’ weighted tagging and reviews and there u have it - crazy? Wait - I’ll say no more I’m having an idea
Regarding the Performance Management angle - hey u send me a good review and I’ll send u one too. Tags directly related to content produced by employees says not very much about the quality of the content - no matter how large the tag.
I did like the sound of SONAR tho when I spoke to one of the dev’s at Pizza on Rails (London) a while back.
Cheers,
Eben
4 Nate Nash // Mar 29, 2008 at 10:11 am
Hi Eben - Thanks for the comment. I will definitely check out Jobster.
I think there will be gaming of any system related to performance management. I would hope that the tag cloud approach served as a tool to help evaluators weed through the real reviews and the quid pro quo reviews.
5 Kevan Hall // Mar 31, 2008 at 5:05 am
Using tag clouds to diagnose what people have actually been doing (in their text interactions at least) is a fascinating idea.
I think many people would be surprised by what they actually spend their time on as distinct from what they think they are doing or what they are supposed to be doing.
I can see people manipulating it but in some ways it would be harder to manipulate this than some traditional subjective performance management tools.
My work is usually with large matrix organizations where organizational complexity can make it hard to get performance input – this idea could help
6 Performance Management in a Matrix // Mar 31, 2008 at 5:22 am
[...] came across a fascinating idea on using tag clouds in performance management at the “Investigating Enterprise 2.0″ blog. Use tag clouds (those lists of keywords you [...]
7 Kevin // Apr 1, 2008 at 9:23 pm
“In reality, I am afraid of heights and fear the worst every time there is in-flight turbulence.”
I’m shocked.
8 wolske // Apr 4, 2008 at 8:30 am
interesting indeed. I think you might be able to reduce the ‘gaming’ of the system if the evaluations are not anonymous… if, as a superior, I can see that all the generous evals are from Joe’s lunch buddies, I can discount their value. if I see the evals are from people I trust (or have no reason to distrust). overlaying some kind of trust-web seems necessary, though I don’t know if that’s something best handled with more technology, or just let it happen naturally (between the ears).
I see this as a problem with LinkedIn already — I have some glowing recommendations, but 3rd parties have no reason to trust them (unless they happen to be one of their direct contacts).
9 As I Do, Not as I Say « Infovark // Apr 4, 2008 at 9:52 am
[...] Nash at e2.oh has an interesting blog post about folksonomy, Facebook and metadata extraction. He wonders whether automatic indexing tools might a better way to get accurate productivity [...]
10 Nate Nash // Apr 7, 2008 at 8:19 am
Excellent point about LinkedIn. Check out the link from the comment above. The folks at Infovark discuss this phenomenon with way more scientific credibility that I do. Not sure if there is an SNS platform that addresses this completely.
11 Insight Can Be Orchestrated // Jun 2, 2008 at 5:57 pm
[...] is where Enterprise 2.0 hold promise. Enterprise social networking tools like Sonar connect employees around themes and competencies. Wikis like Confluence allow staff from differing [...]
Leave a Comment