[Comm2011] Fwd: PPRS-041034-Closed-VST-CASSEGRAIN ROTATOR-Rotator Stuck, not possible to move it even by hand-Electronic
Konrad Kuijken
kuijken at strw.leidenuniv.nl
Mon Aug 20 10:40:55 CEST 2012
Begin forwarded message:
> From: Paranal_AREmail <esoarspl at eso.org>
> Subject: PPRS-041034-Closed-VST-CASSEGRAIN ROTATOR-Rotator Stuck, not possible to move it even by hand-Electronic
> Date: August 16, 2012 0:37:56 GMT+02:00
> To: kuijken at strw.leidenuniv.nl
> Reply-To: Paranal_AREmail <esoarspl at eso.org>
>
> Ticket PPRS-041034 in the Paranal PRS has now been closed.
> A description of the problem, including its resolution, is listed below.
>
>
> Problem Number : PPRS-041034
>
> Creation Date : 2011-08-04 14:09:19 by Ricardo Parra (rparra at eso.org)
> Type : Problem
> Keywords : Rotator Stuck, not possible to move it even by hand
> Priority : Critical
> Deadline :
> Status : Closed
>
> ----- Minor Change Section ---------------------
>
> -------------------------------------------------
>
> Location : VST
> Area/Instrument Type : TELESCOPE
> System/Instrument : CASSEGRAIN ROTATOR
> Sub-system : ROTATOR
>
> Assigned to Group : Electronic
> Assigned to Person : rparra
> CC List :
> kuijken at strw.leidenuniv.nl
> par-tios at eso.org
> rtamai at eso.org
> sguniat at eso.org
> uweilenm at eso.org
> msterzik at eso.org
> vst at eso.org
> par-vst at eso.org
> akaufer at eso.org
> jspyromi at eso.org
> acarlier at eso.orgVst_all
>
> Telescope Downtime : 19:00
> Workload (hrs.) : 63
> Detailed Description :
> When investigating a possible backlash in rotator (see PPRS-041009), in the process of initializing the rotator it stopped moving near the negative end of travel, complaining of a maximum torque exceeded.
> Then we turned on the corresponding manual brake releasing key, and tried to move the rotator by hand. The rotator just moved a couple of milimeters (looking in the rotator periphery) forth and back, but nothing else.
>
> ----- Worklog & Comments Section ---------------
>
> Worklog and Comments :
> 2011-08-04 14:09:20 rparra
> For investigating in deep this problem it would be necessary to remove OmegaCAM. But for removing OmegaCAM the rotator should be at zero degrees, while at present rotator was near the limit and culdn't be moved, it was stuck.
>
> After trying many ways of getting the rotator free to move, it was found that one of the rotator motor brakes was not releasing. This was because of a bad contact somewhere in the electric feeding circuit going to the motor brake inside the rotator.
> As we don't have accesss to the rotator inside, we just tried to move the related cables in order to recover the connection and this was the case. The connection was recovered and brake released, and the rotator could move again after many hours and many people's work.
> Still pending further investigation in order to find the bad contact point and fix it, on the contrary it will happen again.
>
> This experience rises the following red flags:
> - It is necessary to improve reliability of connections, specially in zones which are quite difficult to reach, like rotator inner part, adapter, adc, etc.
> - There is no documentation. All the troubleshooting was done based just on deductions and assumptions.
> - A rotator brakes REAL STATUS is mandatory. Troubleshooting would be quite easier if we have this information.
> 2011-08-19 20:12:03 rparra
> In order to partially overcome the lack of brakes real status, today we installed reed switches detecting current presence corresponding to each of the 2 rotator brakes.
> Then LED's mounted on the brakes junction box and driven by these switches will give a visual indication of the brakes status. When the corresponding brake is consuming power the LED will illuminate.
>
> Something similar should be implemented, but instead of a led the switch must give a status signal to the VME electronics
> 2011-08-25 15:39:21 gutierrf
> This problem appeared again yesterday night, a fuse (F11, 8Amps) was found burned and the current measured in that point, was 9.0 and 9.7 Amp during the initialization. Finally, it was replaced for a new one (8Amp) and the rotator worked again. Having a copy of electrical plans, would have greatly facilitated the work.
>
> GUF/CCR
> 2011-09-09 01:28:11 vst
> This problem occured again tonight and it was impossible to fix.
> After the VST Startup, I tried to send the first Preset of the night but Rotator went to standby everytime.
> I put the system online, tried moving it from the Rotator Engineering Panel but system complained about "average torque exceeded".
> I didnt want to Initialized the device since i do not know if this could recovered so i better called E.Bugueno, he informed me that this issue is kind of known.
>
> At the end Electronic people ended up working on this problem for more than two hours, apparently one of the rotator motor brakes was not releasing.
>
> Logs showed:
>
> After sending the Preset:
> --------------------------------------------------
> 2011-09-08 23:34:16.451112 ltvadc trk trkOB2f7ac08 trkPendingCmd.c:161 64 -351131369 1 W trkERR_AXIS_CNTRL : Axis control returned with FAILURE
> 2011-09-08 23:34:16.838373 wtvst evh trkwsControl evhDB_CMD_SEND.C:866 191 -351131369 2 W evhERR_CMD_ERR_REPLY : Received an error reply to command OBJSTAR from process rottrkServer on environment ltvadc
> 2011-09-08 23:34:16.839504 wtvst prs prsControl PRESET: Command PRESET failed
> ---------------------------------------------------
>
> Trying to move rotator from Engineering Panel:
> ------------------------------------------------------
> 2011-09-09 00:02:45.281162 ltvadc axis rotPresetTask absolute preset of +0d 6m 0.0s -> target position: 0.100000(deg) timeout: 720(sec)
> 2011-09-09 00:02:56.182076 ltvadc axis rotPresetTask axisPreset.c(243) 32 8822 1 S axisERR_TIMEOUT : Timeout on reaching position
> 2011-09-09 00:02:55.889910 ltvadc rot rotServoTask disabling hardware
> 2011-09-09 00:02:56.180891 ltvadc axis rotServoTask axisServoBodyOH.c(93):"rot: Hard switch off due to handled Trigger interlock [0x 2000000] in state Servo State PosPreset"
> 2011-09-09 00:02:55.887921 ltvadc axis rotServoTask axisVelocityControl.c(169) 34 60178 1 W axisERR_ABORT : Movement aborted : maximum average torque exceeded
> -------------------------------------------------------
>
>
> Thanks all the people involved trying to find a solution,
>
> Susana.
> 2011-09-10 22:39:14 fsalgado
> Hi!
>
> Today we continued removing covers to get access to brakes and
> as soon as Matteo could touch the connector in the brake side it reacted,
>
> When the cable was taken out nothing obvious was found on it nor the connectors...
> but anyway we replaced it... (Thanks to Fernando G. and Cristian E.)
>
> so we think that there is still some possibility that the problem could be in the other connector in the brake side
> but we hope not...
>
> for the moment the rotator could go ONLINE.
>
> We left out some covers and cable trays waiting to see how it behaves next days...
> soon we will normalize it.
>
> let's cross fingers...
> Cheers!
> Fdo
> (Special thanks to Juan and Matteo for persisting to find an alternative way to reach the cable)
> Workload added: 3 people x 6 hours + 2 people x 1 hour = 20 hours
> 2011-09-12 21:57:35 vst
> The rotator was stuck again between Sept. 8 and 10, 2011, TSz
> 2011-11-27 11:29:56 rparra
> New occurence: PPRS-042849
> SYMPTOM : Rotator went to standby while tracking
> Problem Type : Electronic
> Detailed Description : Rotator went to standby while tracking with the following
> error:
> 2011-11-27 00:07:32.847871 ltvadc rot
> rotServoTask Active Interlocks: <alias>DRVOK3I
> 2011-11-27 00:07:32.849929 ltvadc rot
> rotServoTask Active Interlocks: <alias>DRVOK3I
> 2011-11-27 00:07:32.850128 ltvadc rot
> rotServoTask disabling hardware
> 2011-11-27 00:07:32.910650 ltvadc axis
> rottr2499460 axisSendRefs.c(282) 58 60178 1 W
> axisERR_TOO_LATE : New reference already in past or not enough margin:
> the delay was 150938.000000 (neg means already in the past)
> 2011-11-27 00:07:32.910890 ltvadc rot
> rottr2499460 vstrotSendRefs.c:195 23 60178 2 S
> vstrotERR_SEND_REFS : Failure from rotator from SendRefs
> 2011-11-27 00:07:33.144083 ltvadc axis
> rotServoTask axisServoBodyOH.c(93):"rot: Hard switch off due to
> handled Trigger interlock [0x 2000000] in state Servo State Pos"
> 2011-11-27 00:07:33.145035 ltvadc axis
> rotServoTask axisServoBodyI.c(72) 71 60178 1 W
> axisERR_INVALID_TRIGGERSTATE_CONT : [41]S:Servo State HwOff
> 2011-11-27 00:07:33.145470 ltvadc axis
> rotServoTask axisServoBodyI.c(72) 71 60178 2 W
> axisERR_INVALID_TRIGGERSTATE_CONT : [132]S:Servo State HwOff
> 2011-11-27 00:07:38.312434 wtvst msw
> trkwsControl Command STOP completed by @ltvaz:aztrkServer
> 2011-11-27 00:07:39.044043 wtvst msw
> trkwsControl Command STOP completed by @ltvalt:alttrkServer
>
>
> R. Parra came to fix the problem. No time lost as we still are in
> twilight
> Time Lost : 00:00
> ACTIONS : 11/27/2011 11:27:49 AM rparra
> Fuse F!! replaced.
> Closed since it is followed on pprs 41034
>
> Status Changed: Open
> Modified By: rparra
> Modified Date: 2011-11-27 11:27:49
> Status Changed: Open
> Modified By: rparra
> Modified Date: 2011-11-27 11:27:49
>
>
> __________________________________________________________________________________
> 2012-08-09 22:54:49 fsalgado
> Assignee changed: rparra
> Modified By: fsalgado
> Modified Date: 2012-08-09 22:54:49
> Assignee changed: rparra
> Modified By: fsalgado
> Modified Date: 2012-08-09 22:54:49
> 2012-08-15 22:36:39 rparra
> No new occurrence after fixing the rotator brakes connections and increasing the fuse capacity from 10 to 12 Amps,
>
> Status Changed: Closed
> Modified By: rparra
> Modified Date: 2012-08-15 22:36:39
> Status Changed: Closed
> Modified By: rparra
> Modified Date: 2012-08-15 22:36:39
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: text/enriched
Size: 11064 bytes
Desc: not available
Url : http://listman.astro-wise.org/pipermail/comm2011/attachments/20120820/947bfa84/attachment-0001.bin
More information about the Comm2011
mailing list