Although the pins would help support it, the crack may still worsen. By milling the pocket out of it, like you did, then you remove the material which contains the line of weakness.
@Mark in Indiana suggested to drill a hole at the end of the crack which is the standard solution because cracks...