Any tricks for finding the path taken by small ESD sparks across a PCB?
$begingroup$
A small ESD spark is able to find its way across my PCB at a relatively low voltage (low kV). It is not obvious which path the spark is taking and the sparks only jump when the board is sealed up inside an assembly so it is not possible to visually see it happen.
Are there any tricks for getting the spark path to leave some sort of trail so after the event we can look at the board and figure out which gaps it is jumping?
I'm thinking there might be some kind of powder or film that discolors or fuses when a spark passes though it, leaving a visual witness mark of the sparks passage.
Any ideas?
esd spark
edited Dec 24 '18 at 8:07
winny
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
$endgroup$
add a comment |
$begingroup$
A small ESD spark is able to find its way across my PCB at a relatively low voltage (low kV). It is not obvious which path the spark is taking and the sparks only jump when the board is sealed up inside an assembly so it is not possible to visually see it happen.
Are there any tricks for getting the spark path to leave some sort of trail so after the event we can look at the board and figure out which gaps it is jumping?
I'm thinking there might be some kind of powder or film that discolors or fuses when a spark passes though it, leaving a visual witness mark of the sparks passage.
Any ideas?
esd spark
edited Dec 24 '18 at 8:07
winny
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
$endgroup$
2
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59
add a comment |
$begingroup$
A small ESD spark is able to find its way across my PCB at a relatively low voltage (low kV). It is not obvious which path the spark is taking and the sparks only jump when the board is sealed up inside an assembly so it is not possible to visually see it happen.
Are there any tricks for getting the spark path to leave some sort of trail so after the event we can look at the board and figure out which gaps it is jumping?
I'm thinking there might be some kind of powder or film that discolors or fuses when a spark passes though it, leaving a visual witness mark of the sparks passage.
Any ideas?
esd spark
edited Dec 24 '18 at 8:07
winny
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
$endgroup$
A small ESD spark is able to find its way across my PCB at a relatively low voltage (low kV). It is not obvious which path the spark is taking and the sparks only jump when the board is sealed up inside an assembly so it is not possible to visually see it happen.
Are there any tricks for getting the spark path to leave some sort of trail so after the event we can look at the board and figure out which gaps it is jumping?
I'm thinking there might be some kind of powder or film that discolors or fuses when a spark passes though it, leaving a visual witness mark of the sparks passage.
Any ideas?
esd spark
esd spark
edited Dec 24 '18 at 8:07
winny
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
edited Dec 24 '18 at 8:07
winny
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
edited Dec 24 '18 at 8:07
winny
4,53931831
edited Dec 24 '18 at 8:07
winny
4,53931831
edited Dec 24 '18 at 8:07
winny
4,53931831
4,53931831
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
asked Dec 24 '18 at 6:08
bigjoshbigjosh
6,9701736
6,9701736
2
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59
add a comment |
2
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59
2
2
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
Do you have a blank board, no components? That's how we usually do it.
Also, what is the source of the kilovolts causing the sparking? Is this your calibrated pulser during an EMC test? Or HV crap coming into the board from long comm lines? Or a 50KV environment such as industrial conveyor belts and rollers?
With a DC HV supply, apply slowly-increasing kilovolts (with current limiter) to the wires soldered to the suspected traces, and watch the obvious visible sparks. Less ideal than a regulated DCKV supply is one of those BD-10 hand-held Tesla coils.
Even try this: figure out how to detect any sparking at all (such as a de-tuned AM radio nearby.) Apply your kilovolts to the pcb to create sparking at a mysterious location. Now, for each suspected sparking location on the board, cover it with a blob of silicone caulk. Assemble everything and apply the kilovolts again. If the same sparking is still there, then do it again, another blob of caulk at another spot. Eventually you'll hit the offending location.
I've seen pcbs with proper HV-holdoff spacing around certain traces, but where nobody checked for HV standoff going vertically through the board. At one spot the 2KV PMT supply trace went right over a piece of internal groundplane. Multilayer board, so very thin epoxy-glass between those layers. After a few years of operation, the HV chewed right through the pcb, creating an unwanted carbon resistor. See Cary Spectrometer PMT shorting.
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
$endgroup$
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
add a comment |
$begingroup$
Air gaps to sharp points are 1kv/mm and flat surfaces are 3kV/mm, assuming clean air low humidity.
Add more gaps for margin. Exposed 5mm LEDs were once notorious for failing ESD tests in keyboards due to the small gap from case to leads with plastic coupling capacitance.
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
$endgroup$
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
|
show 1 more comment
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["\$", "\$"]]);
});
});
}, "mathjax-editing");
StackExchange.ifUsing("editor", function () {
return StackExchange.using("schematics", function () {
StackExchange.schematics.init();
});
}, "cicuitlab");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "135"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2felectronics.stackexchange.com%2fquestions%2f413639%2fany-tricks-for-finding-the-path-taken-by-small-esd-sparks-across-a-pcb%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Do you have a blank board, no components? That's how we usually do it.
Also, what is the source of the kilovolts causing the sparking? Is this your calibrated pulser during an EMC test? Or HV crap coming into the board from long comm lines? Or a 50KV environment such as industrial conveyor belts and rollers?
With a DC HV supply, apply slowly-increasing kilovolts (with current limiter) to the wires soldered to the suspected traces, and watch the obvious visible sparks. Less ideal than a regulated DCKV supply is one of those BD-10 hand-held Tesla coils.
Even try this: figure out how to detect any sparking at all (such as a de-tuned AM radio nearby.) Apply your kilovolts to the pcb to create sparking at a mysterious location. Now, for each suspected sparking location on the board, cover it with a blob of silicone caulk. Assemble everything and apply the kilovolts again. If the same sparking is still there, then do it again, another blob of caulk at another spot. Eventually you'll hit the offending location.
I've seen pcbs with proper HV-holdoff spacing around certain traces, but where nobody checked for HV standoff going vertically through the board. At one spot the 2KV PMT supply trace went right over a piece of internal groundplane. Multilayer board, so very thin epoxy-glass between those layers. After a few years of operation, the HV chewed right through the pcb, creating an unwanted carbon resistor. See Cary Spectrometer PMT shorting.
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
$endgroup$
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
add a comment |
$begingroup$
Do you have a blank board, no components? That's how we usually do it.
Also, what is the source of the kilovolts causing the sparking? Is this your calibrated pulser during an EMC test? Or HV crap coming into the board from long comm lines? Or a 50KV environment such as industrial conveyor belts and rollers?
With a DC HV supply, apply slowly-increasing kilovolts (with current limiter) to the wires soldered to the suspected traces, and watch the obvious visible sparks. Less ideal than a regulated DCKV supply is one of those BD-10 hand-held Tesla coils.
Even try this: figure out how to detect any sparking at all (such as a de-tuned AM radio nearby.) Apply your kilovolts to the pcb to create sparking at a mysterious location. Now, for each suspected sparking location on the board, cover it with a blob of silicone caulk. Assemble everything and apply the kilovolts again. If the same sparking is still there, then do it again, another blob of caulk at another spot. Eventually you'll hit the offending location.
I've seen pcbs with proper HV-holdoff spacing around certain traces, but where nobody checked for HV standoff going vertically through the board. At one spot the 2KV PMT supply trace went right over a piece of internal groundplane. Multilayer board, so very thin epoxy-glass between those layers. After a few years of operation, the HV chewed right through the pcb, creating an unwanted carbon resistor. See Cary Spectrometer PMT shorting.
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
$endgroup$
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
add a comment |
$begingroup$
Do you have a blank board, no components? That's how we usually do it.
Also, what is the source of the kilovolts causing the sparking? Is this your calibrated pulser during an EMC test? Or HV crap coming into the board from long comm lines? Or a 50KV environment such as industrial conveyor belts and rollers?
With a DC HV supply, apply slowly-increasing kilovolts (with current limiter) to the wires soldered to the suspected traces, and watch the obvious visible sparks. Less ideal than a regulated DCKV supply is one of those BD-10 hand-held Tesla coils.
Even try this: figure out how to detect any sparking at all (such as a de-tuned AM radio nearby.) Apply your kilovolts to the pcb to create sparking at a mysterious location. Now, for each suspected sparking location on the board, cover it with a blob of silicone caulk. Assemble everything and apply the kilovolts again. If the same sparking is still there, then do it again, another blob of caulk at another spot. Eventually you'll hit the offending location.
I've seen pcbs with proper HV-holdoff spacing around certain traces, but where nobody checked for HV standoff going vertically through the board. At one spot the 2KV PMT supply trace went right over a piece of internal groundplane. Multilayer board, so very thin epoxy-glass between those layers. After a few years of operation, the HV chewed right through the pcb, creating an unwanted carbon resistor. See Cary Spectrometer PMT shorting.
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
$endgroup$
Do you have a blank board, no components? That's how we usually do it.
Also, what is the source of the kilovolts causing the sparking? Is this your calibrated pulser during an EMC test? Or HV crap coming into the board from long comm lines? Or a 50KV environment such as industrial conveyor belts and rollers?
With a DC HV supply, apply slowly-increasing kilovolts (with current limiter) to the wires soldered to the suspected traces, and watch the obvious visible sparks. Less ideal than a regulated DCKV supply is one of those BD-10 hand-held Tesla coils.
Even try this: figure out how to detect any sparking at all (such as a de-tuned AM radio nearby.) Apply your kilovolts to the pcb to create sparking at a mysterious location. Now, for each suspected sparking location on the board, cover it with a blob of silicone caulk. Assemble everything and apply the kilovolts again. If the same sparking is still there, then do it again, another blob of caulk at another spot. Eventually you'll hit the offending location.
I've seen pcbs with proper HV-holdoff spacing around certain traces, but where nobody checked for HV standoff going vertically through the board. At one spot the 2KV PMT supply trace went right over a piece of internal groundplane. Multilayer board, so very thin epoxy-glass between those layers. After a few years of operation, the HV chewed right through the pcb, creating an unwanted carbon resistor. See Cary Spectrometer PMT shorting.
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
edited Dec 25 '18 at 10:06
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
answered Dec 24 '18 at 6:22
wbeatywbeaty
6,6881025
6,6881025
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
add a comment |
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
1
1
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Testing an empty board should always be the first step, of course, but it's also quite likely that the arc is starting from one of the components, either a sharp edge of a pin or leg, a solder spike, etc. A high sensitivity camera works well testing in complete darkness - a long exposure during operation can produce an image of any arc activity.
$endgroup$
– J...
Dec 24 '18 at 12:28
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
Also, +1 for the Cary link... our 6000 feels like it needs service about every six weeks. I'm going to have a look at that board next time I see it.
$endgroup$
– J...
Dec 24 '18 at 12:42
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
<quote>wires soldered to the suspected traces</quote> The problem is even knowing where to start since I don't even know where the sparks are making it from the housing to the PCB. The jumps only happen when the unit is assembled and sealed up, and no way to see inside when it is happening. Was hoping for a trick to speed up the search! There must be something that will record some kind of change when a spark passes though it?
$endgroup$
– bigjosh
Dec 24 '18 at 18:50
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@bigjosh white paint turns black for power-arcs (using your 30watt KV supply to a dead pcb.) Or this: On a dead board on the bench, first apply KV and detect sparking (with flashing neon bulb to ground, etc.) Then, seal possible spots one at a time with silicone caulk, apply KV each time, until it stops, or until it takes much higher KV. Also, why was KV present? EMC test? Some kind of mysterious failure in the field? (Perhaps add to main description.) I've seen lots of 20KV stuff from conveyor systems.
$endgroup$
– wbeaty
Dec 25 '18 at 9:40
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
$begingroup$
@J... we service only inhouse, draw schematics etc., rebuild charred NMR probes and kilowatt pulse amps. I see design errors all the time. If we sent units out, the same design flaw would just kill it again and again. Heh, a nasty trick is to use an electrolytic cap for supply timing, then put it against a boiling hot to220 regulator package. Your product will mysteriously die in 5-10 years, guaranteed. See the BLAX300 elba-artesyn story, the Eppendorf centrifuge story: staff.washington.edu/wbeaty/chemtrik.html staff.washington.edu/wbeaty/chem-eppndrf.html
$endgroup$
– wbeaty
Dec 25 '18 at 9:48
add a comment |
$begingroup$
Air gaps to sharp points are 1kv/mm and flat surfaces are 3kV/mm, assuming clean air low humidity.
Add more gaps for margin. Exposed 5mm LEDs were once notorious for failing ESD tests in keyboards due to the small gap from case to leads with plastic coupling capacitance.
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
$endgroup$
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
|
show 1 more comment
$begingroup$
Air gaps to sharp points are 1kv/mm and flat surfaces are 3kV/mm, assuming clean air low humidity.
Add more gaps for margin. Exposed 5mm LEDs were once notorious for failing ESD tests in keyboards due to the small gap from case to leads with plastic coupling capacitance.
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
$endgroup$
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
|
show 1 more comment
$begingroup$
Air gaps to sharp points are 1kv/mm and flat surfaces are 3kV/mm, assuming clean air low humidity.
Add more gaps for margin. Exposed 5mm LEDs were once notorious for failing ESD tests in keyboards due to the small gap from case to leads with plastic coupling capacitance.
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
$endgroup$
Air gaps to sharp points are 1kv/mm and flat surfaces are 3kV/mm, assuming clean air low humidity.
Add more gaps for margin. Exposed 5mm LEDs were once notorious for failing ESD tests in keyboards due to the small gap from case to leads with plastic coupling capacitance.
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
answered Dec 24 '18 at 8:06
Sunnyskyguy EE75Sunnyskyguy EE75
64.5k22294
64.5k22294
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
|
show 1 more comment
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
All true - but currently looking for some and diagnosing and debugging advice rather than design advice! Sometimes better to figure out why your car won't start and fix it rather than to buy (or design!) a new car! :)
$endgroup$
– bigjosh
Dec 24 '18 at 19:27
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
Can't you measure the gaps? you can create some magnet wire twisted pair current loops and bring out to a scope to find the ESD path. Is it destructive or not? You can current limit the probe with 1M if it is. Otherwise show photos
$endgroup$
– Sunnyskyguy EE75
Dec 24 '18 at 20:10
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
"Can't you measure the gaps?" Which gaps? So far we can not definitively figure out where the spark is jumping from the enclosure to the PCB.
$endgroup$
– bigjosh
Dec 25 '18 at 2:45
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
YOu haven't given much details on the test or the geometry of dielectrics and conductors so if you can't follow my instructions, you need someone who can.
$endgroup$
– Sunnyskyguy EE75
Dec 25 '18 at 3:08
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
$begingroup$
"You haven't given much details on the test or the geometry" I am not looking for free ESD consulting here! :) Instead I am looking for general techniques to save time by recording the path of a spark when it is not possible to directly see it. If this exists, it would be a handy tool for debugging problems like the one I am facing now.
$endgroup$
– bigjosh
Dec 26 '18 at 3:00
|
show 1 more comment
Thanks for contributing an answer to Electrical Engineering Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2felectronics.stackexchange.com%2fquestions%2f413639%2fany-tricks-for-finding-the-path-taken-by-small-esd-sparks-across-a-pcb%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
$begingroup$
In some sense, it doesn't really matter where the arc is coming from. If this is happening on your board then you've probably violated one or more design rules for HV applications. Personally, I'd review those design rules and compare them with what you've done. Fix everything you've done wrong and the problem should just go away.
$endgroup$
– J...
Dec 24 '18 at 12:31
$begingroup$
@J... "Fix everything you've done wrong and the problem should just go away." It is not always practical to throw away all your inventory and stop everything for a few months while you produce a new design every time you find a new problem! And being the flawed human that I am, it is likely that the new design will have even more things wrong with it than the existing one that has already been few a few refinement cycles!
$endgroup$
– bigjosh
Dec 24 '18 at 19:23
$begingroup$
The point is that if you've gotten yourself into this situation then there are probably other things you've overlooked as well. Presumably you're not discovering this after you've completed prototyping? Now is the best time for a design review - before this thing gets ramped into production, the tooling is finalized, and you're really in trouble.
$endgroup$
– J...
Dec 24 '18 at 20:47
$begingroup$
And sometimes all you can do is cut your losses... Poor design, poor review will always result in poor product. I had to push for a design to be completely scrapped due to poor layout. Yes managers didn't like it,they got vitriolic BUT a fast turnaround is sometimes all you can do. Flash test a bare board. Review your grounding scheme, identify all HV separation, re-assess the needed gap. Measure at Gerber level the separation. Consider conformal coating if external flashover.
$endgroup$
– JonRB
Dec 25 '18 at 10:59