function e=entropy(x) %ENTROPY Entropy of a distribution. % E=ENTROPY(X) computes the entropy of the % distribution X. % % See also MI. % Copyright (c) 1999-2001 by AMRON % Norbert Marwan, Potsdam University, Germany % http://www.agnld.uni-potsdam.de % % $Date$ % $Revision$ % % $Log$ % Revision 2.1 2004/11/10 07:07:51 marwan % initial import % % % This program is free software; you can redistribute it and/or % modify it under the terms of the GNU General Public License % as published by the Free Software Foundation; either version 2 % of the License, or any later version. error(nargchk(1,1,nargin)); if nargout>1, error('Too many output arguments'), end for j=1:size(x,2); x(:,j)=x(:,j)./sum(x(:,j)); x2=x(find(x(:,j)),j); e(:,j)=sum(-x2.*log(x2)); end