Editing Hardware Management/Hardware Fault Management

Jump to navigation Jump to search
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 1: Line 1:
[[File:OCP-Open-compute-hardware-fault-management-icon-3x-v1-1a.png|right]]
[[File:OCP-Open-compute-hardware-fault-management-icon-3x-v1-1a.png|right]]
==Welcome==
==Welcome==


Line 10: Line 9:


==Project Overview==
==Project Overview==
The Hardware Fault Management subproject’s goal is to address the Large scale data center pain-points in managing hardware faults effectively.
The Hardware Fault Management subproject’s goal is to address the Large scale data center pain-points in managing hardware faults effectively.
Objective of the subproject: to define hardware fault management solution such that it


Objective of the subproject: to define hardware fault management solution such that it:
- Minimizes performance degradation
 
- Reduces No Trouble Found (NTF) in RMA
* Minimizes performance degradation
- Scales the solution across heterogeneous fleet
* Reduces No Trouble Found (NTF) in RMA
* Scales the solution across heterogeneous fleet


Activities of the sub-project include:
Activities of the sub-project include:
 
- Develop running list of pain-points related to HW fault handling in the fleet  
* Develop running list of pain-points related to HW fault handling in the fleet  
- Develop hardware fault management solution best practices to address the above pain-points
* Develop hardware fault management solution best practices to address the above pain-points
- Hardware Error reporting format Standardization
* Hardware Error reporting format Standardization
- Define hardware error classification
* Define hardware error classification
- OCP Fault Management Infrastructure Proposal
* OCP Fault Management Infrastructure Proposal
- Standardizing system behavior under hardware failures (future topic)
* Standardizing system behavior under hardware failures (future topic)
- Provide reference and guidance on system hardware failure management (future topic)
* Provide reference and guidance on system hardware failure management (future topic)




==Sub-Project Leadership==
==Sub-Project Leadership==


* [mailto:yogesh.varma@ocproject.net Yogesh Varma] (Intel)
* [mailto:ramab@microsoft.com Rama Bhimanadhuni] (Microsoft)


:- [mailto:ramab@microsoft.com Rama Bhimanadhuni] (Microsoft), [mailto:yogesh.varma@ocproject.net Yogesh Varma] (Intel)


==Get Involved==
==Get Involved==


===Subproject Meets every Friday from 2-3pm PT ===
===Subproject Meets every Friday from 2-3pm PT ===
Please join HWFM meeting from your computer, tablet or smartphone. https://opencompute-org.zoom.us/j/88981755966?pwd=UlN1ZzU3NzV5MU00UjE5Vi8xZUF6Zz09
Please join HWFM meeting from your computer, tablet or smartphone. https://opencompute-org.zoom.us/j/88981755966?pwd=UlN1ZzU3NzV5MU00UjE5Vi8xZUF6Zz09


===Mailing List ===
===Mailing List ===
Participate in the discussion, mailing list: OCP-HWFaultMgt@OCP-All.groups.io [https://ocp-all.groups.io/g/OCP-HWFaultMgt/ Mailing List Info]
Participate in the discussion, mailing list: OCP-HWFaultMgt@OCP-All.groups.io [https://ocp-all.groups.io/g/OCP-HWFaultMgt/ Mailing List Info]


=== Review and provide Feedback ===
=== Review and provide Feedback ===
:Provide feedback and comments to working documents - [https://drive.google.com/drive/folders/1tOtsUfol8g6DKpWOhKyyT_wdKlaE6XH_?usp=sharing Link to In-progress Documents Folder]
==Links to Documents==
===[https://drive.google.com/drive/folders/1tOtsUfol8g6DKpWOhKyyT_wdKlaE6XH_?usp=sharing Work_in_Progress_Documents Folder]:===
- Running list of pain-points related to HW fault handling: [https://drive.google.com/file/d/1zrML07aKGBALBFzClBaM3pZMRZ_K-65r/view?usp=sharing OCP-PainpointList]
- Hardware fault management solution best practices to address the above pain-points: [https://drive.google.com/file/d/1SquZ9DS-BtJ7PnPfth1JtbvMUagNeozF/view?usp=sharing OCP-BestPractice]
- Hardware Error reporting format Standardization: [https://docs.google.com/document/d/1JuxxsrUb5K4JkTxOLTk04fHF1IX_Lauy/edit HW error reporting format]
- Hardware error classification: [https://docs.google.com/document/d/1xQzeYlesh6SV57EA_yxKI30w8H-6Je7B/edit HW Error Classification]
- OCP Fault Management Infrastructure Proposal : [https://drive.google.com/file/d/1A9Qc7hB3THw0wiEK_dbXYj85_NOJWrb5/view?usp=sharing OCP Fault Management Infrastructure Proposal]
===[https://drive.google.com/drive/folders/1Lw7IuM0HHD7F_xAUBZ33GuK0PHW2wMeG?usp=sharing Completed Versions of WIP Documents Folder]===
===[https://drive.google.com/drive/folders/1RLewtetXMHJTPyYCFvoECftaPX0-v-q7?usp=sharing  Published Documents Folder]===


:Provide feedback and comments to working documents - [https://drive.google.com/drive/folders/1v8YeM5IzsimfF41wLGbgtlMRpAkvnmih Link to Work-in-progress Documents Folder]


==Links to OCP HWFM Shared Drive==


====[https://drive.google.com/drive/folders/0AAALnekOYcjbUk9PVA  WIP Documents at HWFM Shared Drive]====


===Presentations & Other Documents===
===Presentations & Other Documents===
OCP Presentation Template - please contact [mailto:michael@opencompute.org Michael Schill] or [mailto:archna@opencompute.org Archna Haylock] for a copy
1. OCP2021 Global Summit: [https://www.youtube.com/watch?v=15yhpo2r7u8 OCP HW Fault Management Sub-project Status Update]
2. OCP2020 Tech Week - Lighting Talk: [https://2020ocptechweek.fnvirtual.app/a/event/863 OCP HW Fault Management Sub-project Update]
3. OCP2020 Global Virtual Summit presentation: [https://onlinexperiences.com/Launch/Event.htm?ShowKey=86206&DisplayItem=E369254 Overview of HW Fault Management Sub-project]
4. OCP2019 Regional Summit: [https://www.youtube.com/watch?v=jBwIBD6izBs Platform Hardware Error Handling Requirements for Large Scale Data Center]


OCP Presentation Template - please contact [mailto:michael@opencompute.org Michael Schill] for a copy
5. OCP2019 Global Summit: [http://www.youtube.com/watch?v=hSHiN4XEJxc Minimizing the performance penalty associated with SMM based hardware error handling solution]


# OCP2023 Global Summit: [https://www.youtube.com/watch?v=udXpp_asrjE&list=PLAG-eekRQBSiXzFSMniAudikWrifOSdV4&index=10 HWFM Infrastructure Framework Requirements Presentation]
6. DMTF/Redfish Hardware Error Reporting Standardization Proposal : [https://docs.google.com/presentation/d/1QTWlN1xTJ2sPFMkizPF_P3PNDxqj1Smm/edit?usp=sharing&ouid=105588765119189812335&rtpof=true&sd=true Hardware Error Reporting Standardization for cloud-scale and Edge Infrastructure presented at OCP2021]
# OCP2023 Global Summit: [https://www.youtube.com/watch?v=s7ExXUcooKY&list=PLAG-eekRQBShiPHyTkmsO_VbkHtmsmnba&index=2 OCP HW Fault Management Sub-project Update]
# OCP2022 Global Summit: [https://www.youtube.com/watch?v=jEvouF0Rdy0&list=PLAG-eekRQBSiXzFSMniAudikWrifOSdV4&index=8  OCP HW Fault Management Sub-project Talk]
# OCP2021 Global Summit: [https://www.youtube.com/watch?v=15yhpo2r7u8 OCP HW Fault Management Sub-project Status Update]
# OCP2020 Tech Week Lighting Talk: (FF 2 Hr) [https://www.youtube.com/watch?v=KZ1NOtj9s5E OCP HW Fault Management Sub-project Update - HWFM, FMFM, RAS API]
# OCP2020 Global Virtual Summit presentation: [https://onlinexperiences.com/Launch/Event.htm?ShowKey=86206&DisplayItem=E369254 Overview of HW Fault Management Sub-project]
# OCP2019 Regional Summit: [https://www.youtube.com/watch?v=jBwIBD6izBs Platform Hardware Error Handling Requirements for Large Scale Data Center]
# OCP2019 Global Summit: [http://www.youtube.com/watch?v=hSHiN4XEJxc Minimizing the performance penalty associated with SMM based hardware error handling solution]
# DMTF/Redfish Hardware Error Reporting Standardization Proposal : [https://docs.google.com/presentation/d/1MAtYV4JY3Rh_OQU7qBhtyBbdQzoXPjXB/edit?usp=drive_link&ouid=115156426268187383009&rtpof=true&sd=true Hardware Error Reporting Standardization for cloud-scale and Edge Infrastructure presented at OCP2021]


==Past Meeting Recordings==  
==Past Meeting Recordings==  
 
:- [https://www.youtube.com/watch?v=Cid1OZOjXks August 18, 2023]
* [https://www.youtube.com/watch?v=joHy5hWefSA Jul 12, 2024]
:- [https://www.youtube.com/watch?v=l2LzJSzVyvE August 11, 2023]
* [https://www.youtube.com/watch?v=Um2siMZZK0A Jun 28, 2024]
:- [https://www.youtube.com/watch?v=l4b9brgBbKo August 4, 2023]
* [https://www.youtube.com/watch?v=rOFkHd3QWQ4 May 31, 2024]
:- [https://www.youtube.com/watch?v=trZ0sI0Vu8s July 28, 2023]
* [https://www.youtube.com/watch?v=WBrYcj9XXyg May 17, 2024]
:- [https://www.youtube.com/watch?v=PI-OZkDGUq4 July 14, 2023]
* [https://www.youtube.com/watch?v=1eintIMkVP8 May 03, 2024]
:- [https://www.youtube.com/watch?v=6rFeFjHMzBw July 7, 2023]
* [https://www.youtube.com/watch?v=9u__yyj6TzY Apr 26, 2024]
:- [https://www.youtube.com/watch?v=M6KhSQCq7RA June 30, 2023]
* [https://www.youtube.com/watch?v=I8dkFoGjKYQ Apr 19, 2024]
:- [https://www.youtube.com/watch?v=2_ZlDNdOWEo May 19, 2023]
* [https://www.youtube.com/watch?v=-8lJfu9j5pc Apr 12, 2024]
:- [https://www.youtube.com/watch?v=jW2KJX22SBo May 12, 2023]
* [https://www.youtube.com/watch?v=mUaXRPyMQ2M Apr 05, 2024]
:- [https://www.youtube.com/watch?v=_0j2_q2EPVo April 14, 2023]
* [https://www.youtube.com/watch?v=oG2qGAhAYqY Mar 22, 2024]
:- [https://www.youtube.com/watch?v=FQCWOAxMq48 March 31, 2023]
* [https://www.youtube.com/watch?v=2qHJOsSI8Rg Mar 15, 2024]
:- [https://www.youtube.com/watch?v=18C_pJj1Onk March 24, 2023]
* [https://www.youtube.com/watch?v=0TlZnrvm_hY Mar 08, 2024]
:- [https://www.youtube.com/watch?v=9Mgwa3-1yb0 March 3, 2023]
* [https://www.youtube.com/watch?v=UgDVxVDCfEs Mar 01, 2024]
:- [https://www.youtube.com/watch?v=1I4Yc9KCauw February 24, 2023]
* [https://www.youtube.com/watch?v=sAIrC9Gp8r0 Feb 23, 2024]
:- [https://www.youtube.com/watch?v=iAY1R3XrRug February 10, 2023]
* [https://www.youtube.com/watch?v=QcGBiHHM-ew Feb 16, 2024]
:- [https://www.youtube.com/watch?v=vKA4nRzhJ18 February 3, 2023]
* [https://www.youtube.com/watch?v=EmmZJAP39XM Feb 9, 2024]
:- [https://www.youtube.com/watch?v=aCG6fmTjfSc Jan 27, 2023]
* [https://www.youtube.com/watch?v=NucBfOu6e3o Feb 2, 2024]
:- [https://www.youtube.com/watch?v=4QAL5bsHdMM Jan 20, 2023]
* [https://www.youtube.com/watch?v=6jDYpFEL4VI Jan 26, 2024]
:- [https://www.youtube.com/watch?v=tU7xwcxoCN0 Jan 13, 2023]
* [https://www.youtube.com/watch?v=BTbctox97pE Jan 19, 2024]
:- January 6, 2023 - No Recording
* [https://www.youtube.com/watch?v=7Mg-m5GeVRI Jan 12, 2024]
:- December 23, 2022 - No Recording
* [https://www.youtube.com/watch?v=qsmZYG3LUSM Jan 5, 2024]
:- [https://www.youtube.com/watch?v=DHJUpGXCtWI December 16th, 2022]
* [https://www.youtube.com/watch?v=JSPJeerFEIs Dec 15, 2023]
:- [https://www.youtube.com/watch?v=jf8HBsof36k December 9th, 2022]
* [https://www.youtube.com/watch?v=CnTnCIu4HCY Dec 8, 2023]
:- [https://www.youtube.com/watch?v=LVcjJ5EgEys December 2nd, 2022]
* [https://www.youtube.com/watch?v=qUv7Rz1jRn4 Dec 1, 2023]
:- [https://www.youtube.com/watch?v=iit_wasD2XA November 18th, 2022]
* [https://www.youtube.com/watch?v=q1TCZFAyTno Nov 17, 2023]
:- [https://www.youtube.com/watch?v=YeNfpVgZyTc November 4th, 2022]
* [https://www.youtube.com/watch?v=-RXoASlE1A4 Nov 10, 2023]
:- [https://www.youtube.com/watch?v=MPbY9-Gtbik October 14th, 2022]
* [https://www.youtube.com/watch?v=XD7G-qyALCk Nov 3, 2023]
:- [https://www.youtube.com/watch?v=oX3fnQaSYtg October 7th, 2022]
* [https://www.youtube.com/watch?v=Vji77sDTQU0 Oct 27, 2023]
:- [https://www.youtube.com/watch?v=eQPX8nBkvdw September 30th, 2022]
* [https://www.youtube.com/watch?v=W0xjCe5o3zQ Oct 6, 2023]
:- [https://www.youtube.com/watch?v=_SGCfWPuNsg September 23rd, 2022]  
* [https://www.youtube.com/watch?v=JiiYtgm9P7o Sep 29, 2023]
:- [https://www.youtube.com/watch?v=KscSFkjNrHo August 26th, 2022]
* [https://www.youtube.com/watch?v=g4XtW35Vnlk Sep 22, 2023]
:- [https://www.youtube.com/watch?v=kBnWEgasnKI August 19th, 2022]
* [https://www.youtube.com/watch?v=Br13EaYN_Ac Sep 15, 2023]
:- [https://www.youtube.com/watch?v=kBnWEgasnKI August 12th, 2022]
* [https://www.youtube.com/watch?v=LOyjX0Be-ek Sep 8, 2023]
:- [https://www.youtube.com/watch?v=clJs-cIexhU August 5th, 2022]
* [https://www.youtube.com/watch?v=h2ZzXGBqkKs Aug 25, 2023]
:- [https://www.youtube.com/watch?v=iZAaFMvY-gc July 29th, 2022]
* [https://www.youtube.com/watch?v=Cid1OZOjXks August 18, 2023]
:- [https://www.youtube.com/watch?v=wWtehCCwdF0 July 15th, 2022]
* [https://www.youtube.com/watch?v=l2LzJSzVyvE August 11, 2023]
:- [https://www.youtube.com/watch?v=7B2ZGhVcN4M June 24th, 2022]  
* [https://www.youtube.com/watch?v=l4b9brgBbKo August 4, 2023]
:- [https://www.youtube.com/watch?v=MP_36y-Ji_Y June 10th, 2022]
* [https://www.youtube.com/watch?v=trZ0sI0Vu8s July 28, 2023]
:- [https://www.youtube.com/watch?v=Hw5VCb7g2xU May 6th, 2022]
* [https://www.youtube.com/watch?v=PI-OZkDGUq4 July 14, 2023]
:- [https://transcripts.gotomeeting.com/#/s/fd568c5cee9ae5bd82ae1873feeeb7f23e147f918dd7e31ff2b8c108ce6abe6e April 22nd, 2022]
* [https://www.youtube.com/watch?v=6rFeFjHMzBw July 7, 2023]
:- [https://www.youtube.com/watch?v=p3Xhep90DW4 April 8th, 2022]
* [https://www.youtube.com/watch?v=M6KhSQCq7RA June 30, 2023]
:- [https://www.youtube.com/watch?v=shwr97O7hTc February 18th, 2022]
* [https://www.youtube.com/watch?v=2_ZlDNdOWEo May 19, 2023]
:- [https://www.youtube.com/watch?v=OHPzb5Fr93E February 11th, 2022]
* [https://www.youtube.com/watch?v=jW2KJX22SBo May 12, 2023]
:- [https://www.youtube.com/watch?v=gnBY7MUgpYA February 4th, 2022]
* [https://www.youtube.com/watch?v=_0j2_q2EPVo April 14, 2023]
:- [https://www.youtube.com/watch?v=iFbm0kAhyLk January 28th, 2022]
* [https://www.youtube.com/watch?v=FQCWOAxMq48 March 31, 2023]
:- [https://www.youtube.com/watch?v=B55zh36OQYI January 21st, 2022]
* [https://www.youtube.com/watch?v=18C_pJj1Onk March 24, 2023]
:- [https://www.youtube.com/watch?v=AXH4isTtfh8 October 8th, 2021]
* [https://www.youtube.com/watch?v=9Mgwa3-1yb0 March 3, 2023]
:- [https://www.youtube.com/watch?v=bx8aaVy1VPk September 17th, 2021]
* [https://www.youtube.com/watch?v=1I4Yc9KCauw February 24, 2023]
:- [https://www.youtube.com/watch?v=7pBzZKf7Nds August 20th, 2021]
* [https://www.youtube.com/watch?v=iAY1R3XrRug February 10, 2023]
:- [https://www.youtube.com/watch?v=dku8mIa7Quc August 13th, 2021]
* [https://www.youtube.com/watch?v=vKA4nRzhJ18 February 3, 2023]
:- [https://www.youtube.com/watch?v=ZupxY_yzHUY July 30th, 2021]
* [https://www.youtube.com/watch?v=aCG6fmTjfSc Jan 27, 2023]
:- [https://www.youtube.com/watch?v=DBfZ4VIlhdI June 25th, 2021]
* [https://www.youtube.com/watch?v=4QAL5bsHdMM Jan 20, 2023]
:- [https://www.youtube.com/watch?v=S9ANhKNFpk0 April 30th, 2021]
* [https://www.youtube.com/watch?v=tU7xwcxoCN0 Jan 13, 2023]
:- [https://www.youtube.com/watch?v=52jkPU2UMeM March 26th, 2021]
* January 6, 2023 - No Recording
:- [https://www.youtube.com/watch?v=_Ua1GE7bY34 February 26th, 2021]
* December 23, 2022 - No Recording
:- [https://www.youtube.com/watch?v=cgC3M4t5C6c January 29th, 2021]
* [https://www.youtube.com/watch?v=DHJUpGXCtWI December 16th, 2022]
:- [https://www.youtube.com/watch?v=gLsfA_uBPQE September 25th, 2020]
* [https://www.youtube.com/watch?v=jf8HBsof36k December 9th, 2022]
:- [https://www.youtube.com/watch?v=jdDykEluzPc August 28th, 2020]
* [https://www.youtube.com/watch?v=LVcjJ5EgEys December 2nd, 2022]
:- [https://www.youtube.com/watch?v=kKpOoNkod4k July 31st, 2020]
* [https://www.youtube.com/watch?v=iit_wasD2XA November 18th, 2022]
:- [https://www.youtube.com/watch?v=R4QnBKAgiZg June 26th, 2020]
* [https://www.youtube.com/watch?v=YeNfpVgZyTc November 4th, 2022]
* [https://www.youtube.com/watch?v=MPbY9-Gtbik October 14th, 2022]
* [https://www.youtube.com/watch?v=oX3fnQaSYtg October 7th, 2022]
* [https://www.youtube.com/watch?v=eQPX8nBkvdw September 30th, 2022]
* [https://www.youtube.com/watch?v=_SGCfWPuNsg September 23rd, 2022]
* [https://www.youtube.com/watch?v=KscSFkjNrHo August 26th, 2022]
* [https://www.youtube.com/watch?v=kBnWEgasnKI August 19th, 2022]
* [https://www.youtube.com/watch?v=kBnWEgasnKI August 12th, 2022]
* [https://www.youtube.com/watch?v=clJs-cIexhU August 5th, 2022]
* [https://www.youtube.com/watch?v=iZAaFMvY-gc July 29th, 2022]
* [https://www.youtube.com/watch?v=wWtehCCwdF0 July 15th, 2022]
* [https://www.youtube.com/watch?v=7B2ZGhVcN4M June 24th, 2022]
* [https://www.youtube.com/watch?v=MP_36y-Ji_Y June 10th, 2022]
* [https://www.youtube.com/watch?v=Hw5VCb7g2xU May 6th, 2022]
* April 22nd, 2022 - No Recording
* [https://www.youtube.com/watch?v=p3Xhep90DW4 April 8th, 2022]
* [https://www.youtube.com/watch?v=shwr97O7hTc February 18th, 2022]
* [https://www.youtube.com/watch?v=OHPzb5Fr93E February 11th, 2022]
* [https://www.youtube.com/watch?v=gnBY7MUgpYA February 4th, 2022]
* [https://www.youtube.com/watch?v=iFbm0kAhyLk January 28th, 2022]
* [https://www.youtube.com/watch?v=B55zh36OQYI January 21st, 2022]
* [https://www.youtube.com/watch?v=AXH4isTtfh8 October 8th, 2021]
* [https://www.youtube.com/watch?v=bx8aaVy1VPk September 17th, 2021]
* [https://www.youtube.com/watch?v=7pBzZKf7Nds August 20th, 2021]
* [https://www.youtube.com/watch?v=dku8mIa7Quc August 13th, 2021]
* [https://www.youtube.com/watch?v=ZupxY_yzHUY July 30th, 2021]
* [https://www.youtube.com/watch?v=DBfZ4VIlhdI June 25th, 2021]
* [https://www.youtube.com/watch?v=S9ANhKNFpk0 April 30th, 2021]
* [https://www.youtube.com/watch?v=52jkPU2UMeM March 26th, 2021]
* [https://www.youtube.com/watch?v=_Ua1GE7bY34 February 26th, 2021]
* [https://www.youtube.com/watch?v=cgC3M4t5C6c January 29th, 2021]
* [https://www.youtube.com/watch?v=gLsfA_uBPQE September 25th, 2020]
* [https://www.youtube.com/watch?v=jdDykEluzPc August 28th, 2020]
* [https://www.youtube.com/watch?v=kKpOoNkod4k July 31st, 2020]
* [https://www.youtube.com/watch?v=R4QnBKAgiZg June 26th, 2020]


== Calendar ==
== Calendar ==
 
:Participate in HW Fault Management sub-project meetings - [https://calendar.google.com/calendar/embed?src=opencompute.org_0bjgh9s81nj0ph2utsr61j0lbg%40group.calendar.google.com&ctz=America%2FChicago OCP Hardware Management Calendar]
:Participate in HW Fault Management sub-project meetings - [https://ocp-all.groups.io/g/OCP-HWFaultMgt/calendar OCP Hardware Management Calendar]
Please note that all contributions to OpenCompute may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see OpenCompute:Copyrights for details). Do not submit copyrighted work without permission!
Cancel Editing help (opens in new window)
Retrieved from "https://www.opencompute.org/w/index.php?title=Hardware_Management/Hardware_Fault_Management"