Applied Skills Assessment seemed wrong - Develop generative AI solutions with Azure OpenAI Service

Hi team, I just finished an Applied Skilled Assesement - Develop generative AI solutions with Azure OpenAI Service. I completed 3 tasks and I believe my output should partially meet the requirements. However, the assessment result showed that I just configured the required resources. I'm not sure why I didn't get any scores on other categories.

Here are some suggestions:

* Update the Azure OpenAI SDK to the latest version. One issue I encountered was the tasks require an outdated Aazure OpenAI SDK that has quite different models and methods. I've created quite a few demos and made talks for local meetups but still need some investigation to complete the tasks. I think it may impact other developers' experience as well.

* Investigate how to correctly assess user's output.

I would like to advocate this certificate for the community but I don't think it's ready at this stage. Let me know if you need more information. Thanks.

Here is the information of my assessment:

  • Title of the Assessment: Develop generative AI solutions with Azure OpenAI Service

  • Lab Instance ID:
    (This can be found in the Instructions tab of the lab. If you have launched the assessment, this is found in the instructions tab under "Troubleshooting").

  • URL: (Copy the entire URL of the problematic page and paste it in your response). https://learn.microsoft.com/en-nz/credentials/applied-skills/develop-generative-ai-solutions-with-azure-openai-service/results?snapshotId=68a162c9-e905-475a-8fc4-7ab11c6fff67

  • Date/Time you encountered the issue: 3 March 2024

  • Description: Explain the primary issue: Wrong assessment result

  • Screenshot of the error:

Hi Xiaodi,

Thank you for contacting the Microsoft Community.

I recognized your time and effort invested in taking the Develop generative AI solutions with Azure OpenAI Service Applied Skills and I know how important it is accomplish the assessment lab. Rest assured that we will look into this matter.

We value your feedback as it also helps us to improve the services provided to every learner to have a smooth experience when taking an assessment lab. The issue you experienced may be transient and should not happen again; We've observed that sometimes learners may overlook the requirements mentioned in the email before starting this lab, which can sometimes lead to experiences similar to yours.

 

We encourage you to review the learning path associated with this Applied Skill as you prepare to retake the assessment lab. When you do, please read the tasks carefully. Many of the mistakes made by learners while completing labs happen because they might miss some details in the emails, forget to complete all required tasks, or do some work outside the virtual machine (VM).

As indicated also on our Assessment lab scoring and score reports | Microsoft Learn, the tasks are scored based on the result, not how you performed the task. You can accomplish the tasks in any way that you would like (for example, through the UI or using PowerShell commands) unless explicitly stated in the email. The scoring script evaluates the result based on the key characteristics to determine if it was performed correctly.

Meanwhile, if you believe that a question on a Microsoft Certification exam or renewal assessment or an assessment lab task is inaccurate, you can request an evaluation of the challenge process designed to help identify and correct problematic questions and tasks, to identify root causes and identify solutions that will improve the experience for everyone. You can submit the Item Challenge Form so that our Microsoft Credentialing team can review the feedback and issues you encountered. Once the review is complete, you will be notified of the outcome in approximately two weeks.

 

I look forward to your response. Please note that if no response is received after three business days, the case will be closed and locked. After the case is locked, we will no longer be able to respond. Thank you.

Warm regards,

Jai_T4
Forum Moderator
Support Period: Monday – Friday (Excluding Holidays)
Hours to Respond: 24 Business Hours

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Thanks for your reply. I'll retake the assessment in the next few days. Also, could you please explain more about "the tasks are scored based on the result, not how you performed the task."? What does the "result" mean here? I saw there were C# and Python applications. Does it mean it assesses the scores by the code, or by the logs? Thanks.

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Hi Xiaodi,

I appreciate your eagerness and dedication to accomplish the assessment lab.

Regarding your query, the tasks are scored based on the result of how many tasks were performed correctly. Usually, you get one point for each task you do correctly. The number of points earned based on your task level performance are summed together and compared to the number of points required to pass.

For more information regarding how assessment labs are being scored, please visit Assessment lab scoring and score reports | Microsoft Learn.

In addition, you can also visit our Prepare for Microsoft Applied Skills assessment lab | Microsoft Learn to help you prepare for your assessment lab.

Once you retry the assessment lab after the cooldown timer and at that time, please make sure that you also review the Assessment Lab System Readiness requirements, and take advantage of the Speed Test and Lab Orientation and Connectivity Check tools available on our FAQ page.

If in case you experience issues with the assessment lab, please make sure to get the following information so that we can more easily investigate and forward it to our Support Team:

  • Title of the Assessment

  • Lab Instance ID: (That can be found in the Instructions tab of the lab. If you have launched the assessment, this is found in the instructions tab under "Troubleshooting.")

  • URL (Copy the entire URL of the problematic page and paste it in your response.)

  • Date/Time you encountered the issue

  • Description (Explain the primary issue)

  • Browser Version

I look forward to your response. Please note that if no response is received after three business days, the case will be closed and locked. After the case is locked, we will no longer be able to respond. Thank you.

Warm regards,

Jai_T4
Forum Moderator
Support Period: Monday – Friday (Excluding Holidays)
Hours to Respond: 24 Business Hours

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Hi there, I just finished the second assessment but still failed. I'm pretty sure I completed all the tasks. The C# code works as expected. Could you please double check my assessment? The lab instance id: 38638792.

I noticed that I should not change any existing code but I did changed a few lines of code in the last asessment. This time, I'm sure I just added required code and the logs should contain all expected output. So not sure why I still failed. It would be great if you can help. Thanks.

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Hi Xiaodi,

Thank you for getting back to me.

I appreciate your time and effort invested in taking the assessment lab and it's something that should not be underestimated. Allow me to check further about this matter and provide options on how to proceed.

Since you mentioned that you have completed all the tasks and still received the same assessment lab result status, kindly submit the Item Challenge Form so that our Microsoft Credentialing team can review the feedback and issues you encountered with your lab. Once the review is complete, you will be notified of the outcome in approximately two weeks.

I'm happy to help you further if you need any additional support. Just let me know and I'll get back to you as soon as possible.

I look forward to your response. Please note that if no response is received after three business days, the case will be closed and locked. After the case is locked, we will no longer be able to respond. Thank you.

Warm regards,

Jai_T4
Forum Moderator
Support Period: Monday – Friday (Excluding Holidays)
Hours to Respond: 24 Business Hours

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Thanks for your reply. I've submitted the item challenge form. Is there anything else I can do now? Thanks.

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Hi Xiaodi,

I hope all is well with you.

We are grateful for your timely and thorough completion of the Item Challenge Form. This is an important step in the process of validating your assessment lab as our Microsoft Credentialing Team will carefully evaluate your submission. With this, you will just need to wait in approximately two weeks as they will directly provide you with the outcome.

We appreciate your patience and cooperation in this process. Please let me know if further assistance is needed.

I look forward to your response. Please note that if no response is received after three business days, the case will be closed and locked. After the case is locked, we will no longer be able to respond. Thank you.

Warm regards,

Jai_T4
Forum Moderator
Support Period: Monday – Friday (Excluding Holidays)
Hours to Respond: 24 Business Hours

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

Hi Xiaodi,

We have not received any update from you. This case will now be locked. If you need further assistance, please post a new question.

Warm Regards,

Jai_T4
Forum Moderator
Support Period: Monday – Friday (Excluding Holidays)
Hours to Respond: 24 Business Hours

Was this reply helpful?

Sorry this didn't help.

Great! Thanks for your feedback.

How satisfied are you with this reply?

Thanks for your feedback, it helps us improve the site.

How satisfied are you with this reply?

Thanks for your feedback.

 
 

Question Info


Last updated October 12, 2024 Views 339 Applies to: