While pensions, endowments, hedge funds and traditional asset managers adjust to a new landscape that features smaller portfolios, more-volatile markets and tighter regulations, insurance companies have been quietly remaking their investment practices.