jupyter转html无图片,Spark + jupyter notebook出现图像无法显示问题解决
最近在使用 Python 学习 user_data = sc.textFile("/home/iteblog/ml-100k/u.user")
user_fields = user_data.map(lambda line: line.split("|"))
ages = user_fields.map(lambda x: int(x[1])).collect()
hist(ages, bins=20, color='lightblue', normed=True)
fig = matplotlib.pyplot.gcf()
fig.set_size_inches(16, 10)
但是运行上面的代码出现了下面的异常： NameError Traceback (most recent call last)
in ()
2
3 ages = user_fields.map(lambda x: int(x[1])).collect()
----> 4 hist(ages, bins=20, color='lightblue', normed=True)
5 fig = matplotlib.pyplot.gcf()
6 fig.set_size_inches(16, 10)
NameError: name 'hist' is not defined
看上面的错误就知道是因为没有引入 hist 所在的类库导致的，我们假设相关依赖，如下： from matplotlib.pylab import *
然后再运行，出现了以下的异常： ---------------------------------------------------------------------------
RuntimeError Traceback (most recent call last)
in ()
2
3 ages = user_fields.map(lambda x: int(x[1])).collect()
----> 4 hist(ages, bins=20, color='lightblue', normed=True)
5 fig = matplotlib.pyplot.gcf()
6 fig.set_size_inches(16, 10)
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/pyplot.pyc in hist(x, bins, range, normed, weights, cumulative, bottom, histtype, align, orientation, rwidth, log, color, label, stacked, hold, data, **kwargs)
2945 rwidth=None, log=False, color=None, label=None, stacked=False,
2946 hold=None, data=None, **kwargs):
-> 2947 ax = gca()
2948 # allow callers to override the hold state by passing hold=True|False
2949 washold = ax.ishold()
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/pyplot.pyc in gca(**kwargs)
926 matplotlib.figure.Figure.gca : The figure's gca method.
927 """
--> 928 return gcf().gca(**kwargs)
929
930 # More ways of creating axes:
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/pyplot.pyc in gcf()
576 return figManager.canvas.figure
577 else:
--> 578 return figure()
579
580
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/pyplot.pyc in figure(num, figsize, dpi, facecolor, edgecolor, frameon, FigureClass, **kwargs)
525 frameon=frameon,
526 FigureClass=FigureClass,
--> 527 **kwargs)
528
529 if figLabel:
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/backends/backend_qt4agg.pyc in new_figure_manager(num, *args, **kwargs)
44 FigureClass = kwargs.pop('FigureClass', Figure)
45 thisFig = FigureClass(*args, **kwargs)
---> 46 return new_figure_manager_given_figure(num, thisFig)
47
48
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/backends/backend_qt4agg.pyc in new_figure_manager_given_figure(num, figure)
51 Create a new figure manager instance for the given figure.
52 """
---> 53 canvas = FigureCanvasQTAgg(figure)
54 return FigureManagerQT(canvas, num)
55
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/backends/backend_qt4agg.pyc in __init__(self, figure)
74 if DEBUG:
75 print('FigureCanvasQtAgg: ', figure)
---> 76 FigureCanvasQT.__init__(self, figure)
77 FigureCanvasQTAggBase.__init__(self, figure)
78 FigureCanvasAgg.__init__(self, figure)
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/backends/backend_qt4.pyc in __init__(self, figure)
66 if DEBUG:
67 print('FigureCanvasQt qt4: ', figure)
---> 68 _create_qApp()
69
70 # Note different super-calling style to backend_qt5
/user/iteblog/anaconda/lib/python2.7/site-packages/matplotlib/backends/backend_qt5.pyc in _create_qApp()
136 display = os.environ.get('DISPLAY')
137 if display is None or not re.search(':\d', display):
--> 138 raise RuntimeError('Invalid DISPLAY variable')
139
140 qApp = QtWidgets.QApplication([str(" ")])
RuntimeError: Invalid DISPLAY variable
上面的错误如果正常情况下，我们可以通过引入下面的类库解决： matplotlib.use('Agg')
但是我们是在 jupyter notebook 上运行上面的代码，所以这个解决不了我们的问题。搜索了好久，终于找到如何解决了，我们可以在代码的最上面加入下面的代码： %matplotlib inline
然后再运行，我们终于可以看到图形了。如下：
如果想及时了解iteblog_hadoop
顺便贴下网上找到的关于 %matplotlib inline 的描述：
%matplotlib inline works on Jupyter notebook. It makes matplotlib plot on notebook itself, instead of a DEVICE。