A neoplasm with neuroendocrine differentiation that arises from the pancreas. It includes neuroendocrine tumors (low and intermediate grade) and neuroendocrine carcinomas (high grade).