General Readiness for On-Call DRI
Register IcM Profile
Follow IcM wiki for My Profile, Log in into IcM site https://portal.microsofticm.com/ with your **AAD account (alias@microsoft.com)** and create your personal profile. TIP: Remember to register your phone number in profile, and test it works, so that you can get notification when live-site happen during On-Call rotation.
Get Ready for MSAI Data DRI
Get Ready for MSAI Data DRI by following the steps below and you can get some additional information in the reference.
Step 1 : Torus account ready
All the steps you need to follow to acquire a valid Torus account.
Step 2 : Yubikey enrolled
Please make sure you have received a Yubikey.
The YubiKey will ship to you.
Step 3 : SAW machine ready
Please check if you have setup your SAW machine environment and ready for take the DRI actions.
Please follow below pipeline to acquire a SAW machine.
Go to http://assetmgr/ and click create request.
Fill in the building, office, cost center and justification. Then click Submit Directly below the SAW
Join ASG-O365 Slio at https://sasweb.microsoft.com/Member?JoinSilo=true and wait for approval
STCA IT will contact you when your SAW is ready.
Step 4 : Permission application and grant
1. SG
Open IdWeb page: https://idweb/identitymanagement/default.aspx
Make sure you already join these SGs on IdWeb
| Type | Name |
|---|---|
| SG | NgpKustoReader |
2. OSP
Open OSP page: https://osp.office.net
Make sure you have already requested the follow clearences and eligibilities on OSP portal.
- 2.1 Clearances
| CLEARANCE | VALUE | EXPIRES ON |
|---|---|---|
| BackgroundCheck | CN | Sunday, July 11, 2021 5:00 PM PDT |
| Training | FISMA | N/A, yearly |
| EUPIAttestation | Saturday, December 26, 2020 9:12 PM PST |
- 2.2 Eligibilities
| ELIGIBILITY | WORKLOAD | Notes |
|---|---|---|
| Griffin Partner Access | Exchange | For Cosmos VC access, Request basic eligibility |
| CVC_OffConsPUID | Exchange | For VC Office.Consumer.PUID |
| CVC_Off_Eng | Exchange | For VC Office.Engineering |
| ExoStrProd_RWX | Exchange | For ADLS/ADLA exchange-storage-prod-c14, and production Blueshift accounts: - ADLA: substrateadlaneuprod - ADLS Gen2: substrateadlsg2neuprod, substrateadlsg2neurawlog |
| CVC_Off_Adhoc | Exchange | For VC Office.Adhoc |
| CVC_OBD_prod | Exchange | For VC OBD.Prod |
| Off_Adhoc_RWX | Exchange | For ADLS/ADLS off-adhoc-c14 |
| Off_Eng_RWX | Exchange | For ADLS/ADLA off-eng-c14 |
| CVC_ExoStrProd | Exchange | For VC Exchange.Storage.Prod |
| SSSDSM | Exchange | For AurigaSentry monitors, AurigaSentryPortal and Metrics Advisor(MA) |
| msaidataplat | Exchange | For Serach ADF msai-datapipeline |
| SotelsSharedRes | Exchange | For sotels shared blueshift resources: - ADLA: adlasotelstest, sotelssharedadlawus2 - ADLS Gen2: adlsg2sotelstest, sotelssharedstoragewus2 |
3. [Deprecated] IDEAs
Make sure you request the IDEAs ActionView permission
4. [Deprecated] Phoenix
Phoenix is used for the deployment. So you need to confirm you can access the Auriga Phoenix. If you cannot, please contact Jia Zheng or Junyang Wang to add you into the allowed list.
5. AurigaSentry
Please check if you have permission to open Home Page - AurigaSentryPortal. If you don't, please contact Yanzhen Liu or Xin Zhao.
6. Access to Kensho/Metrics Advisor(MA) monitor datafeeds
- Kensho monitor
Kensho data feeds are granted to 3sexpdri@microsoft.com alias. Pls fisrt join the DRI group on ICM portal.
The data feed 3S EXP DRI are expected to access on Kensho are:
| DATAFEED | Link |
|---|---|
| [RoW] DataVolumn_CookGWSLogsHourly_Merge24Hour | https://tsana.azurewebsites.net/data-feed/7f263864-7044-457e-9e2d-e402ab1ca0ba |
| [RoW] DataVolumn_Cook3SEventsLogsHourly_Merge24Hour | https://tsana.azurewebsites.net/data-feed/892c6dd0-82bc-4e94-af63-fcbaf2690e82 |
| [RoW] DataVolumn_CookAriaEventsLogsHourly_Merge24Hour | https://tsana.azurewebsites.net/data-feed/9cf3c17c-a2b7-47a6-8128-2f85bd83d99b |
| [RoW] DataVolumn_LogicalSearchImpressionHourly_Merge24Hour | https://tsana.azurewebsites.net/data-feed/88a4c815-f01c-46d5-adc7-0b5818d687e8 |
| [RoW] DataVolumn_FastSessionComputation_Daily | https://tsana.azurewebsites.net/data-feed/361fff83-3029-430d-a774-0f65113a9a1f |
| [RoW] Malformed Raw Line Count | https://tsana.azurewebsites.net/data-feed/2825cd29-01c4-46fb-a2e1-69bd350ae2ee |
- Metrics Advisor monitor
MA data feed access is needed to add one by one. Pls contact any of the 3sexpdri member to add data feed to you.
The data feed 3S EXP DRI are expected to access on MA are:
| DATAFEED | LINK |
|---|---|
| [EU] DataVolumn_CookGWSLogsHourly_Merge24Hour | https://metricsadvisor.azurewebsites.net/data-feed/b12191cf-d7a0-4a2f-b68b-563d02c45684 |
| [EU] DataVolumn_Cook3SEventsLogsHourly_Merge24Hour | https://metricsadvisor.azurewebsites.net/data-feed/3898f08c-a879-4e18-a6bd-28721de5f22a |
| [EU] DataVolumn_CookAriaEventsLogsHourly_Merge24Hour | https://metricsadvisor.azurewebsites.net/data-feed/e51feaa9-ab98-4393-ad22-8667e0103862 |
| [EU] DataVolumn_LogicalSearchImpressionHourly_Merge24Hour | https://metricsadvisor.azurewebsites.net/data-feed/ad329d59-f350-4652-baca-af70e9035c18 |
| [EU] DataVolumn_FastSessionComputation_Daily | https://metricsadvisor.azurewebsites.net/data-feed/b7439ced-861d-4e92-9366-6fdcc2fab313 |
| [EU] Malformed Raw Line Count | https://metricsadvisor.azurewebsites.net/data-feed/320a8a9d-444b-4403-937a-d7abfc3758c9 |
| SearchImpression_FastMetrics_SmartDetectionEU | https://metricsadvisor.azurewebsites.net/data-feed/328dd2f9-5aab-474e-99a3-4ae634e2450b |
| SearchImpression_GwsLogsHourly_CompletenessEU | https://metricsadvisor.azurewebsites.net/data-feed/104a38d3-171b-4542-8cfd-3158bf67efcf |
| sssClientInstrumentationDataQualityMetrics-Event-Distribution | https://metricsadvisor.azurewebsites.net/data-feed/992c897e-5610-429b-a6ef-2aaac5b0a244 |
| sssClientInstrumentationDataQualityMetrics-Event-Distribution-EU | https://metricsadvisor.azurewebsites.net/data-feed/e319ac64-1e1c-4a53-9706-9d2f129dcbc8 |
| sssClientInstrumentationDataQualityMetrics-GuardrailKey | https://metricsadvisor.azurewebsites.net/data-feed/10d4b4dd-5d0e-4d02-9258-77976a5e910d |
| sssClientInstrumentationDataQualityMetrics-GuardrailKey-EU | https://metricsadvisor.azurewebsites.net/data-feed/7b918c57-c51f-41a0-b372-f7ffeeb4fa71 |
| [Teams Desktop][R1] Client Instrumentation Data Quality Metrics | https://metricsadvisor.azurewebsites.net/data-feed/5f4824df-1ce6-4ecb-9697-be73c8ce0e2e |
| sssUsageQualityOfServiceMetric-SearchQualityOfService | https://metricsadvisor.azurewebsites.net/data-feed/88501bf2-95b8-4072-91d0-e634e6c2583a |
| sssUsageQualityOfServiceMetric-SearchQualityOfService-EU | https://metricsadvisor.azurewebsites.net/data-feed/34106f71-e8ed-4fda-94a6-8b26750b152f |
| sssUsageQualityOfServiceMetric-SlowSearchQualityOfService | https://metricsadvisor.azurewebsites.net/data-feed/df586d40-f296-42ea-8d71-968d517d4caf |
| sssUsageQualityOfServiceMetric-SlowSearchQualityOfService-EU | https://metricsadvisor.azurewebsites.net/data-feed/57c0d988-e34e-4ab5-b74a-efc44e095791 |
| sssEngagementMetrics-DefaultEngagementMain | https://metricsadvisor.azurewebsites.net/data-feed/19646461-b55d-46da-ad15-8690f2f81ec7 |
| sssEngagementMetrics-DefaultEngagementMain-EU | https://metricsadvisor.azurewebsites.net/data-feed/ef922979-70c4-48b2-ba00-b73100f07ed3 |
| sssEngagementMetrics-SlowDefaultEngagementMain | https://metricsadvisor.azurewebsites.net/data-feed/634c8d00-bf3b-4a74-bdce-4a02dfdd5ffb |
| sssEngagementMetrics-SlowDefaultEngagementMain-EU | https://metricsadvisor.azurewebsites.net/data-feed/bbcb54cb-029c-4189-9378-4e2b8e8db12c |
| sssSuccessMetrics-MSO | https://metricsadvisor.azurewebsites.net/data-feed/d1dcb92f-ca93-4367-bfe8-76b8898f5093 |
| sssSuccessMetrics-MSO-EU | https://metricsadvisor.azurewebsites.net/data-feed/66a375ca-8b3b-411a-8fee-06bf9d91a527 |
| sssSuccessMetrics-MSB | https://metricsadvisor.azurewebsites.net/data-feed/6e821ffb-c9c1-4b4e-91cf-de76eadd39a8 |
| sssSuccessMetrics-MSB-EU | https://metricsadvisor.azurewebsites.net/data-feed/7c60be55-6d23-44a2-94cc-a9d37855f5d8 |
| sssSuccessMetrics-Teams | https://metricsadvisor.azurewebsites.net/data-feed/33dd3f8b-d6c6-4da1-a266-4ddf0ec18492 |
| sssSuccessMetrics-Teams-EU | https://metricsadvisor.azurewebsites.net/data-feed/d679909f-6387-4d3f-9112-0e3c3d13c673 |
| sssSuccessMetrics-Outlook | https://metricsadvisor.azurewebsites.net/data-feed/541db1a7-9f93-4099-ad5d-e43f3db796bc |
| sssSuccessMetrics-Outlook-EU | https://metricsadvisor.azurewebsites.net/data-feed/613e848f-88b5-4212-8a3b-9413a86cbd1f |
Reference
Understand the DRI responsibilty
Read this page: DRI Responsibilities
Background knowledge
Video sharing for ADF, Critical path, please open the link to see
See the video to learning about:
MSAI Data Platform data cooking pipeline critical path
How to use Dragonfly to submit test Cosmos Jobs.
ADF platform operations
AurigaSentry Portal
How to tag the streams using powershell, please open the link to see the video
Data Cooking Pipeline Updated Documents
Torus Enabled Subscription
| Subscription | Permission Application (Contributor Role) | Link | Note |
|---|---|---|---|
| SSSDSM | Request-AzureSubscriptionElevation -Role Contributor -SubscriptionId 8228d12f-ea13-416f-91c7-76afaeb89c83 -Reason "debug Sentry monitors" | https://portal.azure.com/#@prdtrs01.onmicrosoft.com/resource/subscriptions/8228d12f-ea13-416f-91c7-76afaeb89c83/overview | For Sentry debug For Phoenix Debug |
| MSAI Data Platform | Request-AzureSubscriptionElevation -Role Contributor -SubscriptionId 8b8b2cf1-f7e3-4d86-8581-a15cd35463a4 -Reason ***"Reason for elevation"*** | https://portal.azure.com/#@prdtrs01.onmicrosoft.com/resource/subscriptions/8b8b2cf1-f7e3-4d86-8581-a15cd35463a4/overview | For ADF pipelines |
To make the JIT request being able to revoke, use this:
Request-AzureResourceRoleElevation -Role Contributor -SubscriptionId 8b8b2cf1-f7e3-4d86-8581-a15cd35463a4 -ResourceGroup Sentry -Reason "ADF pipeline" -Duration 4
Request-AzureResourceRoleElevation -Role Contributor -SubscriptionId 8b8b2cf1-f7e3-4d86-8581-a15cd35463a4 -ResourceGroup MSAI-DataPipeline -Reason "ADF pipeline" -Duration 4
To revoke, use this:
Remove-AzureResourceRoleElevation -Role Contributor -SubscriptionId 8b8b2cf1-f7e3-4d86-8581-a15cd35463a4
Remove-AzureResourceRoleElevation -RequestorAlias {Your Alias}
JIT Access suggestions:
Request a JIT access before going to sleep. If there is any urgent issue, make a call to secondary DRI for JIT approval.