|
Post by imiram1372 on May 13, 2010 16:24:10 GMT -5
Kilgore -- Good luck to you and your appeal. Your story is just too depressing to think about. However, your positive attitude throughout this whole process has been so encouraging to me.
|
|
|
Post by 71stretch on May 13, 2010 17:14:38 GMT -5
Kilgore -- Good luck to you and your appeal. Your story is just too depressing to think about. However, your positive attitude throughout this whole process has been so encouraging to me. And to all the rest of us, too. I remember worrying about having to use a laptop keyboard, which I'm not used to, for the WD. How relieved was I that they hooked up regular keyboards. That seems like a small thing compared to your situation. I don't know what I would have done if the laptop had malfunctioned as yours did, but I'm not sure I'd have handled all of it as well as you have.
|
|
|
Post by privateatty on May 13, 2010 17:37:45 GMT -5
Here is how. With a full panel you have three individual raters who give you a score. For arguments sake lets say with the three member panel you get 60 points. Assuming the overall score is divided by three your SI would be 20. Now you have a two member panel. Your score from the two members is 40 obvioiusly your overall would be 20 if you divided by two. However, say the GS-5 clerk tallying the scores just assumes three members for every panel. Your 40 is divided by three and your overall score becomes 13.3. I think you have been hurt. Oh an by the way I received a NOR despite the fact my WD was not rated due to a malfunction of the laptop I was using. My rating was based purely on the SI and AR. It was 38.97. I am assuming I received a zero for my WD. I am appealling. I am also contemplating other actions. kilgore, you got bushwacked and have a great appeal. We all have compassion for this dastardly tale of woe. You pay for their crash? Pu-leeze. But your SI score calculations just don't hold water. No ALJ would sit still for it. And while I have no love for OPM, I can't believe they would score the SI as you envision. Besides, there are high scorers who had two person panels. Having said that I improved my score with a 3 person panel over the previous two person one. However, those two were very unpleasant and clearly not receptive to a "privateatty"...having a lawyer made all the difference I think.
|
|
|
Post by Propmaster on May 16, 2010 13:46:36 GMT -5
What I am having trouble understanding is why the SI, which was short and an awkward format and didn't seem to correlate well with the skills to actually be an ALJ, would count so much. After all, the AR isn't supposed to be evaluated on the format itself but is supposed to take into account the totality of our career and therefore our qualification to be an ALJ. It seems like it's just become form over function with the AR. Honestly, I find it just odd that the SI would count so much, whereas our whole career would count so little. IMHO, at least the WD was related to one of the skills of being an ALJ -- writing. Granted the set up was very artificial, but at least they had the right skill. The SI remains a mystery to me. I must have done poorly, since I got a stunningly low overall score, but I couldn't pinpoint why that's true. Keep in mind that the AR is scored first and provides a cut-off; so in many ways it is the most important. Only people who are above a certain AR score go on; and the added WD and SI form the majority of difference among the applicants. This is actually pretty true whether or not the suggested formula in this thread is correct (and I think it is a very clever analysis).
|
|
|
Post by Propmaster on May 16, 2010 13:53:04 GMT -5
.... Oh an by the way I received a NOR despite the fact my WD was not rated due to a malfunction of the laptop I was using. My rating was based purely on the SI and AR. It was 38.97. I am assuming I received a zero for my WD. I am appealling. I am also contemplating other actions. This seems to belie the calculations proposed earlier in the thread. If WD is only about 20 points out of 100, and the AR cutoff is about halfway, it would mean Kilgore could get a perfect WD and a 57 score and must have tanked the SI. Frankly, given Kilgore's posts, I doubt that more than I believe the presumed score breakdown.
|
|
|
Post by tigerfan on May 16, 2010 17:54:54 GMT -5
It my understanding that the spread of scores for the 2 panel and 3 panel interviews are about the same so whether you had a 2 member panel or 3 member panel probably makes no difference. I also believe that all panel members have to agree to a single composite score on each question again narrowing the margin for large flucuations in scores whether 2 panel or 3 panel membership.
|
|
|
Post by masondixon on May 16, 2010 20:53:32 GMT -5
I tend to favor the idea that what takes more time to complete probably counts the most. The WD takes 4 hours, and the AR is supposed to take even more time. I think they are more important to calculating the final rating than the SI. I simply do not believe OPM weights all three parts equally as it implies within the ALJ announcement.
|
|
|
Post by 71stretch on May 16, 2010 22:30:17 GMT -5
I tend to favor the idea that what takes more time to complete probably counts the most. The WD takes 4 hours, and the AR is supposed to take even more time. I think they are more important to calculating the final rating than the SI. I simply do not believe OPM weights all three parts equally as it implies within the ALJ announcement. Actually, what it says is that all the competencies were weighted equally. As was mentioned either earlier on this thread or elsewhere, not all the competencies are measured in each of the three parts. Makes figuring out how this works even more difficult. Byzantine, indeed.
|
|
|
Post by tiggen on May 17, 2010 23:18:18 GMT -5
Are scores rounded up/down to the nearest whole number in the cert and offer process?
|
|
|
Post by sunshinedaydream on May 28, 2018 13:01:31 GMT -5
I'm just going to post the contents so people can see what is being discussed. This is my first rodeo, so I can't compare it to previous ones. Based on the previous emails though, the AR was reasoning, and the SI added self-managment and stress tolerance. The "??" in the fourth paragraph were present in the original email (at least as forwarded to my Blackberry). Subject: Understanding Your ALJ Final Numerical Rating
Dear ALJ Applicant,
You recently received a Notice of Results (NOR) indicating that you had successfully completed all parts of the Administrative Law Judge (ALJ) examination and that your name and final numerical rating would be placed on the current ALJ register being maintained by the U.S. Office of Personnel Management (OPM). The purpose of this notice is to provide a brief explanation to help you understand how the ALJ final numerical ratings were calculated.
As stated in the vacancy announcement, the purpose of the ALJ examination is to evaluate applicants on the competencies essential to the work of an ALJ. For the Accomplishment Record (AR), applicants provided written statements of their accomplishments, which were scored. All applicants were ranked based on their AR scores, including any applicable veterans' preference points. The applicants who were among the higher AR scores from all eligible applicants were identified and moved on to the next stages of the assessment process. Because your AR score was among the higher AR scores, you were invited to participate in the Written Demonstration (WD) and Structured Interview (SI) portions of the ALJ assessment.
The competencies measured in the AR, the WD, and the SI were combined to determine a total competency score. For this step, any veterans' preference points added to the AR score (as discussed in the previous paragraph) were not included; instead veterans' preference points were added to the numerical rating at the end of the scoring process, as indicated below. To compute this total competency score, the following steps were taken:
??The competencies were made equal in importance, so that each competency carried equal weight, ??The points earned on each competency were added together to determine the total competency scores for each applicant, and ??The total competency scores of all applicants were put on a 1 to 100 scale to establish each applicant's numerical rating, excluding veterans' preference. In this scale, the lowest possible score is 1 and the highest possible score is 100.
This numerical rating, plus any applicable veterans' preference points, is the final numerical rating noted on the NOR. Every applicant on the register has already exceeded an initial cut-off score because OPM identified the higher scored applicants after rating the AR. Therefore, OPM did not employ any subsequent screen-out or passing score when adding new names to the current ALJ register.
As stated on the NOR, your name will be placed on the current register in rank order based on your final numerical rating. This list will be used as a source of names to make referrals to agencies for employment consideration.
Competencies: 1) Decision Making, 2) Interpersonal Skills, 3) Oral Communication, 4) Writing, 5) Judicial Analysis, 6) Judicial Management, 7) Reasoning, 8) Self Management, and 9) Stress Tolerance.
We hope this information is helpful to you. |
This post is from 2010, when there were fewer competencies listed, but does anyone know whether the final numerical rating is calculated in the same way? I was thinking that each component of the "exam" (e.g., SJT, SI, WD) was assigned a weight. Instead, it seems that each component tests for certain competencies, and the scores for each competency are added together for the final numerical rating.
|
|
|
Post by Pixie on May 28, 2018 14:40:02 GMT -5
Are scores rounded up/down to the nearest whole number in the cert and offer process? The score is given to two decimal points. Pixie
|
|
|
Post by sunshinedaydream on May 28, 2018 15:30:34 GMT -5
Does the final rating still come from scores for equally weighted competencies (rather than performance on individual components of the exam)?
|
|
|
Post by gary on May 28, 2018 15:38:36 GMT -5
Does the final rating still come from scores for equally weighted competencies (rather than performance on individual components of the exam)? Yes.
|
|
|
Post by bayou on May 28, 2018 17:15:02 GMT -5
Does the final rating still come from scores for equally weighted competencies (rather than performance on individual components of the exam)? There is a thread started by Gaidin in 2014 that discusses grading for the current register. IIRC, the title says something about OPM grading.
|
|
|
Post by sunshinedaydream on May 28, 2018 18:25:32 GMT -5
Does the final rating still come from scores for equally weighted competencies (rather than performance on individual components of the exam)? There is a thread started by Gaidin in 2014 that discusses grading for the current register. IIRC, the title says something about OPM grading. Yes, thank you. Here is that thread, for anyone else interested: aljdiscussion.proboards.com/thread/2486/message-opm-grading?page=1
|
|