accel/habanalabs: prevent sending heartbeat before events are enabled
authorfarah kassabri <fkassabri@habana.ai>
Sun, 27 Aug 2023 16:01:20 +0000 (19:01 +0300)
committerOded Gabbay <ogabbay@kernel.org>
Mon, 9 Oct 2023 09:37:21 +0000 (12:37 +0300)
After the heartbeat mechanism is now expanded to be used also
for EQ health check, we shouldn't send heartbeat messages
to FW before driver allow events to be received from FW.

Because if the driver will send two heartbeats before it enables
events to be received from FW, then the EQ health check
will fail and reset the device.

Signed-off-by: farah kassabri <fkassabri@habana.ai>
Reviewed-by: Oded Gabbay <ogabbay@kernel.org>
Signed-off-by: Oded Gabbay <ogabbay@kernel.org>
drivers/accel/habanalabs/common/device.c

index 1d1ccd8d5c7506fe005e4c86a5c6eb7f530c1a72..0c9ba09c1b75ac8150dd925a7e51a5211177f34d 100644 (file)
@@ -994,12 +994,7 @@ static void hl_device_eq_heartbeat(struct hl_device *hdev)
        u64 event_mask = HL_NOTIFIER_EVENT_DEVICE_RESET | HL_NOTIFIER_EVENT_DEVICE_UNAVAILABLE;
        struct asic_fixed_properties *prop = &hdev->asic_prop;
 
-        /*
-         * This feature supported in FW version 1.12.0 45.2.0 and above,
-         * only on those FW versions eq_health_check_supported will be set.
-         * Start checking eq health only after driver has enabled events from FW.
-         */
-       if (!prop->cpucp_info.eq_health_check_supported || !hdev->init_done)
+       if (!prop->cpucp_info.eq_health_check_supported)
                return;
 
        if (hdev->eq_heartbeat_received)
@@ -1015,7 +1010,8 @@ static void hl_device_heartbeat(struct work_struct *work)
        struct hl_info_fw_err_info info = {0};
        u64 event_mask = HL_NOTIFIER_EVENT_DEVICE_RESET | HL_NOTIFIER_EVENT_DEVICE_UNAVAILABLE;
 
-       if (!hl_device_operational(hdev, NULL))
+       /* Start heartbeat checks only after driver has enabled events from FW */
+       if (!hl_device_operational(hdev, NULL) || !hdev->init_done)
                goto reschedule;
 
        /*