How to use leaky ReLus as the activation function in hidden layers in pylearn2

I am using pylearn2 library to design a CNN. I want to use Leaky ReLus as the activation function in one layer. Is there any possible way to do this using pylearn2? Do I have to write a custom function for it or does pylearn2 have inbuilt funtions for tha? If so, how to write a custom code? Please can anyone help me out here?

-------------Problems Reply------------

ConvElemwise super-class is a generic convolutional elemwise layer. Among its subclasses ConvRectifiedLinear is a convolutional rectified linear layer that uses RectifierConvNonlinearity class.

In the apply() method:

p = linear_response * (linear_response > 0.) + self.left_slope *\
linear_response * (linear_response < 0.)

As this gentle review points out:

... Maxout neuron (introduced recently by Goodfellow et al.) that generalizes the ReLU and its leaky version.

Examples are MaxoutLocalC01B or MaxoutConvC01B.

The reason for lack of answer in pylearn2-user may be that pylearn2 is mostly written by researches at LISA lab and, thus, the threshold for point 13 in FAQ may be high.

Category:machine learning Views:0 Time:2018-01-16

Related post

  • How to use 2 classes for the same function with jQuery 2011-08-10

    How do I run the same click function for 2 classes ? I have this : $('.buythis').click(function(){ blabla } And I want to use the same line for a different class like : $('.anotherclass').click(function(){ blabla } Now ... how can I use the same clic

  • I would like to know how I can add attributes to the activity entity 2010-08-16

    I would like to know how I can add attributes to the activity entity. Currently the default activities are Email, Task, Letter, Fax, Phone call, Appointment, Campaign, Service I would like to add more to the pick-list. I have already tried going into

  • What is a derivative of the activation function used for in backpropagation? 2012-03-20

    I am reading this document, and they stated that the weight adjustment formula is this: new weight = old weight + learning rate * delta * df(e)/de * input The df(e)/de part is the derivative of the activation function, which is usually a sigmoid func

  • How to use jQuery to change the backgound color of a textbox? 2009-08-03

    How to use jQuery to change the backgound color of a textbox? --------------Solutions------------- Better practice is to seperate UI from logic, in your case: $("#textboxid").addClass("aClass"); If you really need it your way, then do the following:

  • How do I use inverted commas in the echo function in PHP? 2010-05-19

    How do I use inverted commas in the echo function in PHP? echo "<script type="text/javascript">"; doesnt work well. Thank you! --------------Solutions------------- Escape them with backslashes: echo "<script type=\"text/javascript\">"; Al

  • How do I use a variable in the animate() function in jQuery? 2010-07-14

    I have been able to store the height for my image in a variable: var origh4 = $('img:eq(3)').height(); However, now I would like to use that variable in the animate function like so: $('img:first').fadeIn('normal').delay(500).animate({'height':'-=20%

  • How to use a UserControl inside the EditTemplate of a ListVIew? 2010-10-05

    Here is the situation: I have a ListView showing just a list of concatenated strings obtained from different field of the objects of the datasource. A LinkButton (with CommandName="Edit") in each row Event handlers for OnItemDataBound and OnItemEditi

  • How to use Django to get the name for the host server? 2010-11-04

    How to use Django to get the name for the host server? I need the name of the hosting server instead of the client name? --------------Solutions------------- I generally put something like this in settings.py: import socket try: HOSTNAME = socket.get

  • iphone--how to use checkmark to filter the information? 2010-12-23

    I know how to add checkmark into the tableview, but the question is how to use checkmark to filter the information? That means if i have checked item-1, in the table view or view just display the related information about item-1. Anyone can help me o

  • How to use php regular get the 2ed and 3rd ``? 2011-01-31

    There have some texts, how to use php regular get the 2ed and 3rd <div class="partright">? Thanks. <div class="wrap"> <div class="content> <div class="partleft"> text1 </div> <div class="partright"> text2 </div

  • How to use NSTimer to check the performance of function? 2011-07-05

    How to use NSTimer to check the performance of function? Actually, I am making a dylib which is Cydia Software. I have found many resources, but I still don't know which part of my functions slow down whole program. I need someone's help.... --------

  • How to Use FFMPEG in inside the Delphi 2012-01-31

    Iam beginner in delphi.i create the one sample application i need one help.how to use FFMPEG in inside the delphi? --------------Solutions------------- FFMPEG is a command line app, so you can easily call it using ShellExecute(), with some examples h

  • How to use Birthday Template in "The Works, v9". 2012-03-06

    I need instructions on how to use Birthday Template in "The Works, v9". How come instructions do not come with how to use templates? I need instructions on how to use "The Works, v9" to make birthday cards. --------------Solutions------------- Hello

  • I had the iso file of Windows 7 RTM Ultimate (I didn't have the registion code) but I didn't know how to use it to recover the lost system files.Can you help me? 2012-03-21

    I downloaded Windows 7 RTM iso file (7600) from the Internet and made it a Dual system(XP Home/7 Ultimate_unregisted) successfully,but soon windows 7 told me that my file system (only the Windows 7 partition) had mistakes and I had to reboot and scan

  • How to use Graphic Images from the Internet ? 2015-03-09

    How to use Graphic Images from the Internet ? --------------Solutions------------- If you don't find the image you want in the MS Clip Art Gallery, one good option is to take images off the World Wide Web. You can save these files and insert them int

  • How can I pass parameters to the OnSuccess function of the AjaxOptions class in ASP.NET MVC? 2010-04-09

    How can I pass parameters to the OnSuccess function of the AjaxOptions class in ASP.NET MVC? Here's my code but it doesn't work: <%= Ajax.ActionLink("Delete", "Delete", "MyController", New With {.id = record.ID}, New AjaxOptions With { .Confirm =

  • how to use a variable passed as a function argument 2011-12-10

    UPDATE I had a small typo , everything its working like it should. I can't figure out how to use a variable passed as a function argument in an multiple ajax call as a selector. First and Second are OK but when calling ThirdCallbackFunction clicking

  • How to use a global variable within a function in Haskell 2014-05-17

    In section Incorrectly matching against a variable from chapter 3 of real world haskell, there is an example as follows: -- file: ch03/BogusPattern.hs data Fruit = Apple | Orange apple = "apple" orange = "orange" whichFruit :: String -> Fruit whic

  • Using Javascript to change the method/function an HTML element calls 2010-01-13

    I was wondering if its possible to use Javascript to change the function/method that an HTML element calls. Example: <input type="button" id="some_id" name="some_name" value="A Button" onclick="someFunction()" /> I now want to use Javascript to

  • How can I passing value into the JavaScript function in asp:LinkButton OnClientClick? 2011-08-09

    Does anyone know how can I passing value into the javascript function in asp:LinkButton OnClientClick? Example: If I have the following code: <asp:ListView ID="lvTeams" runat="server" DataSourceID="dsTeams" DataKeyNames="ReferenceValue" OnItemComm

  • using query results in the same function that calls them 2011-08-11

    For some reason I am unable to use query results in the same function that calls them. Please see controller below and model and let me know where my issue is. What breaks down is line 2 of controller, trying to concatenate query result contact_name

  • How do I get rid of the MAX function? 2013-02-11

    Original title: Excel 2003 Dear all, When I block a range of cells, the MAX function appears, instead of the usual Autosum formula. How do I get rid of the MAX function? Many thanks --------------Solutions------------- I assume you mean the MAX appea

  • how to use android tabs in the same Activity 2010-08-23

    Hallo, Any idea where I can find a simple tabs example? The Android Developers Hello Views Tab Layout example only details how to use separate Activities for each Tab. I would like to use tabs to extend a screen of settings without scrolling, i.e. th

  • How to know if MySQLnd is the active driver? 2009-09-25

    Maybe it's an obvious question, but I want to be sure. How can i know if it MySQLnd is the active driver? I'm runing PHP 5.3 and MySQL 5.1.37. In phpinfo() mysqlnd is listed but only with this I can't be sure if I'm using MySQLnd or the old driver...

Copyright (C) dskims.com, All Rights Reserved.

processed in 0.132 (s). 11 q(s)